Sep 09 03:33:38 devstack cinder-volume[76609]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 03:33:38 devstack cinder-volume[76609]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 03:33:38 devstack cinder-volume[76609]: we strongly recommend against using it for new projects. Sep 09 03:33:38 devstack cinder-volume[76609]: If you are already using Eventlet, we recommend migrating to a different Sep 09 03:33:38 devstack cinder-volume[76609]: framework. For more detail see Sep 09 03:33:38 devstack cinder-volume[76609]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 03:33:38 devstack cinder-volume[76609]: import eventlet # noqa Sep 09 03:33:41 devstack cinder-volume[76609]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76609) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 03:33:41 devstack cinder-volume[76609]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76609) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 03:33:41 devstack cinder-volume[76609]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76609) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 03:33:42 devstack cinder-volume[76609]: INFO dbcounter [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Registered counter for database cinder Sep 09 03:33:42 devstack cinder-volume[76609]: DEBUG oslo_db.sqlalchemy.engines [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76609) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:33:42 devstack cinder-volume[76609]: DEBUG dbcounter [-] [76609] Writer thread running {{(pid=76609) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 03:33:42 devstack cinder-volume[76609]: INFO cinder.rpc [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 03:33:42 devstack cinder-volume[76609]: INFO cinder.rpc [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_db.sqlalchemy.engines [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76609) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:33:43 devstack cinder-volume[76609]: INFO cinder.volume.manager [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Determined volume DB was empty at startup. Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG cinder.volume.manager [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76609) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 03:33:43 devstack cinder-volume[76609]: INFO cinder.volume.manager [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 03:33:43 devstack cinder-volume[76609]: WARNING stevedore.named [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 03:33:43 devstack cinder-volume[76609]: WARNING castellan.key_manager [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 03:33:43 devstack cinder-volume[76609]: WARNING cinder.keymgr.conf_key_mgr [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG cinder.volume.drivers.lvm [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76609) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_concurrency.processutils [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76609) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_concurrency.processutils [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] CMD "cinder-rtstool verify" returned: 0 in 0.492s {{(pid=76609) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_db.sqlalchemy.engines [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76609) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:33:43 devstack cinder-volume[76609]: INFO cinder.rpc [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 09 03:33:43 devstack cinder-volume[76609]: INFO cinder.rpc [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 09 03:33:43 devstack cinder-volume[76609]: WARNING stevedore.named [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 03:33:43 devstack cinder-volume[76609]: WARNING castellan.key_manager [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 03:33:43 devstack cinder-volume[76609]: INFO cinder.volume.manager [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_db.sqlalchemy.engines [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76609) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:33:43 devstack cinder-volume[76609]: INFO oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Starting 1 workers Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Started child 76762 {{(pid=76609) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Full set of CONF: {{(pid=76609) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] ******************************************************************************** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Configuration options gathered from: {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] ================================================================================ {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] allow_availability_zone_fallback = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] allow_compression_on_image_upload = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] allowed_direct_url_schemes = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] api_rate_limit = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76762]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] auth_strategy = keystone {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] az_cache_duration = 3600 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_availability_zone = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_host = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_stats_polling_interval = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backup_api_class = cinder.backup.api.API {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backup_name_template = backup-%s {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backup_use_same_host = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backup_use_temp_snapshot = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] chap_password = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] chap_username = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_internal_tenant_project_id = acaffa7c685849e3948d13def08b0b72 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_internal_tenant_user_id = 2a37f7b86d294bf9b0a54fe0783a9e8a {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cloned_volume_same_az = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cluster = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] compression_format = gzip {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] compute_api_class = cinder.compute.nova.API {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] config_dir = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] config_source = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] control_exchange = openstack {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] debug = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] default_availability_zone = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] default_group_type = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] default_volume_type = lvmdriver-1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] disk_geometry = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] driver_client_cert = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] driver_client_cert_key = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] driver_data_namespace = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] driver_ssl_cert_path = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] driver_ssl_cert_verify = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] driver_use_ssl = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] enable_force_upload = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] enable_new_services = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] enable_unsupported_driver = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] enforce_multipath_for_image_xfer = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] filter_function = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_api_insecure = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_api_servers = ['http://192.168.122.49/image'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_api_ssl_compression = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_ca_certificates_file = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_catalog_info = image:glance:publicURL {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_certfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_keyfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_num_retries = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance_request_timeout = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] goodness_function = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] graceful_shutdown_timeout = 5 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76762]: INFO cinder.volume.manager [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] group_api_class = cinder.group.api.API {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] host = devstack {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_compress_on_upload = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_conversion_address_space_limit = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_conversion_cpu_limit = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_conversion_disable = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_upload_use_cinder_backend = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_upload_use_internal_tenant = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_volume_cache_enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_volume_cache_max_count = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] image_volume_cache_max_size_gb = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] init_host_max_objects_retrieval = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] instance_format = [instance: %(uuid)s] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] iscsi_target_flags = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] iscsi_write_cache = on {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] iser_helper = tgtadm {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] iser_ip_address = 192.168.122.49 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] iser_port = 3260 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_color = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_config_append = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_dir = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_file = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_options = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_rotate_interval = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_rotate_interval_type = days {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] log_rotation_type = none {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] max_age = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] max_logfile_count = 30 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] max_logfile_size_mb = 200 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] max_over_subscription_ratio = 20.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] message_reap_interval = 86400 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] message_ttl = 2592000 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] migration_create_volume_timeout_secs = 300 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] monkey_patch = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] monkey_patch_modules = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] my_ip = 192.168.122.49 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] no_snapshot_gb_quota = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] num_iser_scan_tries = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] num_shell_tries = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] num_volume_device_scan_tries = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:43 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] nvmeof_conn_info_version = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] nvmet_ns_id = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] nvmet_port_id = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] osapi_max_limit = 1000 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] osapi_volume_ext_list = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] osapi_volume_listen_port = 8776 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] osapi_volume_use_ssl = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] osapi_volume_workers = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] per_volume_size_limit = -1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] periodic_fuzzy_delay = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] periodic_interval = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] public_endpoint = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] publish_errors = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] quota_backup_gigabytes = 1000 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] quota_backups = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] quota_gigabytes = 1000 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] quota_groups = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] quota_snapshots = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] quota_volumes = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] rate_limit_burst = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] rate_limit_except_level = CRITICAL {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] rate_limit_interval = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] reinit_driver_count = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] replication_device = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] report_discard_supported = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] report_interval = 120 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] reservation_clean_interval = 86400 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] reservation_expire = 86400 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] reserved_image_namespaces = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] reserved_percentage = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] rpc_response_timeout = 120 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] run_external_periodic_tasks = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] scst_target_driver = iscsi {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] scst_target_iqn_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_down_time = 720 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] shell_completion = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] snapshot_name_template = snapshot-%s {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] snapshot_same_host = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] split_loggers = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] state_path = /opt/stack/data/cinder {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] storage_availability_zone = nova {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] storage_protocol = iSCSI {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] syslog_log_facility = LOG_USER {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] target_helper = lioadm {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] target_ip_address = 192.168.122.49 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] target_port = 3260 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] target_protocol = iscsi {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] target_secondary_ip_addresses = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] trace_flags = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] transport_url = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] until_refresh = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] use_chap_auth = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] use_default_quota_class = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] use_journal = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] use_json = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] use_multipath_for_image_xfer = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] use_stderr = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] use_syslog = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] verify_glance_signatures = enabled {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_api_class = cinder.volume.api.API {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_backend_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_clear = zero {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_clear_ionice = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_clear_size = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_copy_bps_limit = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_dd_blocksize = 1M {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_name_template = volume-%s {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_service_inithost_offload = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volume_usage_audit_period = month {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] zoning_mode = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_concurrency.disable_process_locking = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.auth_section = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.auth_type = password {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.auth_version = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.cache = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.certfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.include_service_catalog = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.insecure = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.interface = public {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.keyfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_password = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcache_username = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.region_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.service_type = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.49/identity {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.backend = dogpile.cache.null {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.backend_argument = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.backend_expiration_time = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.config_prefix = cache.oslo {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.debug_cache_backend = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.enable_retry_client = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.enable_socket_keepalive = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.expiration_time = 600 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.hashclient_retry_attempts = 2 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.memcache_dead_retry = 300 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.memcache_pool_maxsize = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.memcache_sasl_enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.password = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.proxies = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.redis_db = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.redis_server = localhost:6379 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.retry_attempts = 2 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.retry_delay = 0.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.socket_keepalive_count = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.socket_keepalive_idle = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.socket_keepalive_interval = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.socket_timeout = 1.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.tls_allowed_ciphers = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.tls_cafile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.tls_certfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.tls_enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.tls_keyfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cache.username = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] coordination.backend_url = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.asyncio_connection = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.asyncio_slave_connection = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.backend = sqlalchemy {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.connection = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.connection_debug = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.connection_parameters = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.connection_recycle_time = 3600 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.connection_trace = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.db_inc_retry_interval = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.db_max_retries = 20 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.db_max_retry_interval = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.db_retry_interval = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.max_overflow = 50 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.max_pool_size = 5 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.max_retries = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.mysql_wsrep_sync_wait = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.pool_timeout = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.retry_interval = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.slave_connection = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.sqlite_synchronous = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.synchronous_reader = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] database.use_db_reconnect = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_tracing.insecure = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.connection_string = messaging:// {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.es_doc_type = notification {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.es_scroll_size = 10000 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.es_scroll_time = 2m {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.filter_error_trace = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.hmac_keys = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.sentinel_service_name = mymaster {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.socket_timeout = 0.1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.trace_requests = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler.trace_sqlalchemy = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler_jaeger.process_tags = {} {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler_jaeger.service_name_prefix = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] profiler_otlp.service_name_prefix = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.enforce_new_defaults = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.policy_default_rule = default {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.policy_file = policy.yaml {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] privsep_osbrick.group = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] privsep_osbrick.helper_command = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] privsep_osbrick.user = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_sys_admin.group = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_sys_admin.helper_command = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] cinder_sys_admin.user = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.auth_section = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.auth_type = password {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.cafile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.certfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.collect_timing = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.insecure = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.keyfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.send_service_user_token = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.split_loggers = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.timeout = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.tls_ciphers = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] service_user.tls_min_version = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.auth_section = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.auth_type = password {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.certfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.collect_timing = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.insecure = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.keyfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.region_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.split_loggers = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.timeout = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.tls_ciphers = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] glance.tls_min_version = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.backend_availability_zone = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.chap_password = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.chap_username = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.disk_geometry = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.driver_client_cert = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.driver_client_cert_key = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.driver_data_namespace = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.driver_use_ssl = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.extra_capabilities = {} {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.filter_function = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.goodness_function = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.iscsi_target_flags = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.iscsi_write_cache = on {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.iser_helper = tgtadm {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.iser_ip_address = 192.168.122.49 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.iser_port = 3260 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.lvm_share_target = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.lvm_type = auto {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.num_shell_tries = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.replication_device = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.report_discard_supported = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.reserved_percentage = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.target_helper = tgtadm {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.target_ip_address = 192.168.122.49 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.target_port = 3260 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.target_protocol = iscsi {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.trace_flags = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.unique_fqdn_network = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.use_chap_auth = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_backend_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_clear = zero {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_clear_ionice = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_clear_size = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_reports.file_event_handler = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_reports.log_dir = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.backend_host = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.chap_password = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.chap_username = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.disk_geometry = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.driver_client_cert = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.extra_capabilities = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.filter_function = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.goodness_function = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.iser_helper = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.iser_ip_address = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.iser_port = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.lvm_share_target = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.lvm_type = auto {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.num_shell_tries = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.replication_device = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.report_discard_supported = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.reserved_percentage = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.scst_target_driver = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.storage_protocol = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.target_helper = lioadm {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.target_ip_address = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.target_port = 3260 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.trace_flags = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.use_chap_auth = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_clear = zero {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_clear_size = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] lvmdriver-1.volumes_dir = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.ssl = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_notifications.driver = [] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_notifications.retry = -1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] key_manager.fixed_key = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.barbican_api_version = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.barbican_endpoint = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.barbican_endpoint_type = public {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.barbican_region_name = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.cafile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.certfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.collect_timing = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.insecure = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.keyfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.number_of_retries = 60 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.retry_delay = 1 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.send_service_user_token = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.split_loggers = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.timeout = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.tls_ciphers = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.tls_min_version = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.verify_ssl = True {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican.verify_ssl_path = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.auth_section = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.auth_type = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.cafile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.certfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.collect_timing = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.insecure = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.keyfile = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.split_loggers = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.timeout = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.tls_ciphers = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] barbican_service_user.tls_min_version = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.approle_role_id = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.approle_secret_id = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.auth_method = approle {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.auth_path = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.kv_mountpoint = secret {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.kv_path = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.kv_version = 2 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.namespace = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.root_token_id = **** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.ssl_ca_crt_file = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.timeout = 60.0 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.token_file = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.token_role = None {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.use_ssl = False {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:33:44 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] ******************************************************************************** {{(pid=76609) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 03:33:44 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.386s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:44 devstack sudo[76934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:44 devstack sudo[76934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:44 devstack sudo[76934]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.251s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:33:44 devstack cinder-volume[76762]: INFO cinder.brick.local_dev.lvm [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:44 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:44 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:33:44 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:44 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG cinder.brick.local_dev.lvm [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76762) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:45 devstack sudo[77103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:45 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:45 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:45 devstack sudo[77287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:45 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:45 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:45 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:45 devstack sudo[77374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 09 03:33:45 devstack sudo[77374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:46 devstack sudo[77374]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:46 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.269s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:46 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:46 devstack sudo[77377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:33:46 devstack sudo[77377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:46 devstack sudo[77377]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:46 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:46 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:46 devstack sudo[77461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:33:46 devstack sudo[77461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:46 devstack sudo[77461]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:46 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:46 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:46 devstack sudo[77464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:33:46 devstack sudo[77464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:46 devstack sudo[77464]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:47 devstack sudo[77510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:47 devstack sudo[77510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:47 devstack sudo[77510]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:47 devstack sudo[77563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:47 devstack sudo[77563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:47 devstack sudo[77563]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:47 devstack cinder-volume[76762]: INFO cinder.volume.drivers.lvm [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:47 devstack sudo[77567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:47 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:47 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG cinder.volume.drivers.lvm [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Updating volume stats {{(pid=76762) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 03:33:47 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:47 devstack sudo[77570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:33:47 devstack sudo[77570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:48 devstack sudo[77570]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:48 devstack sudo[77574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:33:48 devstack sudo[77574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:48 devstack sudo[77574]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:48 devstack sudo[77577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:48 devstack sudo[77577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:48 devstack sudo[77577]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:48 devstack sudo[77580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:33:48 devstack sudo[77580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:48 devstack sudo[77580]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:48 devstack cinder-volume[76762]: INFO cinder.volume.driver [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG cinder.volume.driver [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76762) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 03:33:48 devstack cinder-volume[76762]: DEBUG oslo_db.sqlalchemy.engines [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76762) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG dbcounter [-] [76762] Writer thread running {{(pid=76762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG cinder.db.api [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Building query based on filter {{(pid=76762) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG cinder.image.image_utils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76762) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 03:33:49 devstack cinder-volume[76762]: INFO cinder.keymgr.migration [None req-a2cfb582-3fe6-4e6a-8ea6-b23ae1512bdd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG cinder.volume.drivers.lvm [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Updating volume stats {{(pid=76762) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:49 devstack sudo[77583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:33:49 devstack sudo[77583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:49 devstack sudo[77583]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:49 devstack sudo[77589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:33:49 devstack sudo[77589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:49 devstack sudo[77589]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:49 devstack sudo[77594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:49 devstack sudo[77594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:49 devstack sudo[77594]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:49 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:49 devstack sudo[77597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:33:49 devstack sudo[77597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:50 devstack sudo[77597]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG cinder.manager [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Notifying Schedulers of capabilities ... {{(pid=76762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:33:50 devstack cinder-volume[76762]: INFO cinder.volume.manager [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Driver initialization completed successfully. Sep 09 03:33:50 devstack cinder-volume[76762]: INFO cinder.manager [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Initiating service 2 cleanup Sep 09 03:33:50 devstack cinder-volume[76762]: INFO cinder.manager [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Service 2 cleanup completed. Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG cinder.service [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Creating RPC server for service cinder-volume {{(pid=76762) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG cinder.service [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76762) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 03:33:50 devstack cinder-volume[76762]: INFO cinder.volume.manager [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG cinder.volume.drivers.lvm [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Updating volume stats {{(pid=76762) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:50 devstack sudo[77600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:33:50 devstack sudo[77600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:50 devstack sudo[77600]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:50 devstack sudo[77608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:33:50 devstack sudo[77608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:50 devstack sudo[77608]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:50 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:50 devstack sudo[77611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:33:50 devstack sudo[77611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:51 devstack sudo[77611]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:51 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:51 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:33:51 devstack sudo[77614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:33:51 devstack sudo[77614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:33:51 devstack sudo[77614]: pam_unix(sudo:session): session closed for user root Sep 09 03:33:51 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:33:51 devstack cinder-volume[76762]: INFO cinder.volume.manager [None req-e2dc288a-c209-42ab-a6cd-9f5c4eeed441 None None] Driver post RPC initialization completed successfully. Sep 09 03:33:53 devstack cinder-volume[76609]: DEBUG dbcounter [-] [76609] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76609) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:34:01 devstack cinder-volume[76762]: DEBUG dbcounter [-] [76762] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:34:01 devstack cinder-volume[76762]: DEBUG dbcounter [-] [76762] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:34:01 devstack cinder-volume[76762]: DEBUG oslo_service.periodic_task [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running periodic task VolumeManager._thread_info {{(pid=76762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:34:01 devstack cinder-volume[76762]: DEBUG cinder.volume.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] thread count: 6 {{(pid=76762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:34:01 devstack cinder-volume[76762]: DEBUG cinder.volume.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] thread info: [<_MainThread(MainThread, started 125394466574464)>, , , , , ] {{(pid=76762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:35:01 devstack cinder-volume[76762]: DEBUG oslo_service.periodic_task [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:35:01 devstack cinder-volume[76762]: DEBUG cinder.volume.drivers.lvm [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Updating volume stats {{(pid=76762) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 03:35:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:35:01 devstack sudo[79802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:35:01 devstack sudo[79802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:35:01 devstack sudo[79802]: pam_unix(sudo:session): session closed for user root Sep 09 03:35:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:35:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:35:01 devstack sudo[79861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:35:01 devstack sudo[79861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:35:02 devstack sudo[79861]: pam_unix(sudo:session): session closed for user root Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:35:02 devstack sudo[79864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:35:02 devstack sudo[79864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:35:02 devstack sudo[79864]: pam_unix(sudo:session): session closed for user root Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:35:02 devstack sudo[79967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:35:02 devstack sudo[79967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:35:02 devstack sudo[79967]: pam_unix(sudo:session): session closed for user root Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG cinder.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Notifying Schedulers of capabilities ... {{(pid=76762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG oslo_service.periodic_task [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running periodic task VolumeManager._thread_info {{(pid=76762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG cinder.volume.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] thread count: 6 {{(pid=76762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:35:02 devstack cinder-volume[76762]: DEBUG cinder.volume.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] thread info: [<_MainThread(MainThread, started 125394466574464)>, , , , , ] {{(pid=76762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:36:01 devstack cinder-volume[76762]: DEBUG dbcounter [-] [76762] Writing DB stats cinder:SELECT=1 {{(pid=76762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:36:01 devstack cinder-volume[76762]: DEBUG dbcounter [-] [76762] Writing DB stats cinder:UPDATE=1 {{(pid=76762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:36:01 devstack cinder-volume[76762]: DEBUG oslo_service.periodic_task [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:36:01 devstack cinder-volume[76762]: DEBUG cinder.volume.drivers.lvm [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Updating volume stats {{(pid=76762) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 03:36:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:36:01 devstack sudo[83155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:36:01 devstack sudo[83155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:36:01 devstack sudo[83155]: pam_unix(sudo:session): session closed for user root Sep 09 03:36:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:36:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:36:01 devstack sudo[83159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:36:01 devstack sudo[83159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:36:02 devstack sudo[83159]: pam_unix(sudo:session): session closed for user root Sep 09 03:36:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:36:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:36:02 devstack sudo[83166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:36:02 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:36:02 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root Sep 09 03:36:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:36:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:36:02 devstack sudo[83170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:36:02 devstack sudo[83170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:36:02 devstack sudo[83170]: pam_unix(sudo:session): session closed for user root Sep 09 03:36:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:36:02 devstack cinder-volume[76762]: DEBUG cinder.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Notifying Schedulers of capabilities ... {{(pid=76762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:37:01 devstack cinder-volume[76762]: DEBUG oslo_service.periodic_task [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:37:01 devstack cinder-volume[76762]: DEBUG cinder.volume.drivers.lvm [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Updating volume stats {{(pid=76762) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 03:37:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:37:01 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:37:01 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:37:01 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Sep 09 03:37:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:37:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:37:01 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:37:01 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:37:02 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:37:02 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:37:02 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:37:02 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:37:02 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:37:02 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:37:02 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG cinder.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Notifying Schedulers of capabilities ... {{(pid=76762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG oslo_service.periodic_task [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running periodic task VolumeManager._thread_info {{(pid=76762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG cinder.volume.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] thread count: 6 {{(pid=76762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:37:02 devstack cinder-volume[76762]: DEBUG cinder.volume.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] thread info: [<_MainThread(MainThread, started 125394466574464)>, , , , , ] {{(pid=76762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:38:01 devstack cinder-volume[76762]: DEBUG dbcounter [-] [76762] Writing DB stats cinder:SELECT=1 {{(pid=76762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:38:01 devstack cinder-volume[76762]: DEBUG dbcounter [-] [76762] Writing DB stats cinder:UPDATE=1 {{(pid=76762) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:38:01 devstack cinder-volume[76762]: DEBUG oslo_service.periodic_task [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:38:01 devstack cinder-volume[76762]: DEBUG cinder.volume.drivers.lvm [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Updating volume stats {{(pid=76762) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 03:38:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:01 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 03:38:01 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:01 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:01 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:01 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:38:01 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:02 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:02 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 03:38:02 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:02 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:02 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 03:38:02 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:02 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG oslo_concurrency.processutils [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76762) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG cinder.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Notifying Schedulers of capabilities ... {{(pid=76762) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG oslo_service.periodic_task [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] Running periodic task VolumeManager._thread_info {{(pid=76762) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG cinder.volume.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] thread count: 6 {{(pid=76762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:38:02 devstack cinder-volume[76762]: DEBUG cinder.volume.manager [None req-7e33526c-b862-4a64-92c2-b2b6b6b15c76 None None] thread info: [<_MainThread(MainThread, started 125394466574464)>, , , , , ] {{(pid=76762) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:38:10 devstack cinder-volume[76609]: INFO oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Caught SIGTERM, stopping children Sep 09 03:38:10 devstack cinder-volume[76609]: DEBUG oslo_concurrency.lockutils [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Acquiring lock "singleton_lock" {{(pid=76609) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 03:38:10 devstack cinder-volume[76609]: DEBUG oslo_concurrency.lockutils [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Acquired lock "singleton_lock" {{(pid=76609) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 03:38:10 devstack cinder-volume[76609]: DEBUG oslo_concurrency.lockutils [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Releasing lock "singleton_lock" {{(pid=76609) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 03:38:10 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Stop services. {{(pid=76609) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 03:38:10 devstack cinder-volume[76609]: DEBUG oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Killing children. {{(pid=76609) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 03:38:10 devstack cinder-volume[76609]: INFO oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Waiting on 1 children to exit Sep 09 03:38:15 devstack cinder-volume[76762]: DEBUG oslo_concurrency.lockutils [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Acquiring lock "singleton_lock" {{(pid=76762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 03:38:15 devstack cinder-volume[76762]: DEBUG oslo_concurrency.lockutils [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Acquired lock "singleton_lock" {{(pid=76762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 03:38:15 devstack cinder-volume[76762]: DEBUG oslo_concurrency.lockutils [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Releasing lock "singleton_lock" {{(pid=76762) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 03:38:15 devstack cinder-volume[76762]: WARNING amqp [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 03:38:15 devstack cinder-volume[76762]: WARNING amqp [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 03:38:15 devstack cinder-volume[76609]: INFO oslo_service.backend._eventlet.service [None req-ff0b1f7b-b957-4bad-810b-9b5248a44436 None None] Child 76762 exited with status 0 Sep 09 03:38:15 devstack cinder-volume[86753]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 03:38:15 devstack cinder-volume[86753]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 03:38:15 devstack cinder-volume[86753]: we strongly recommend against using it for new projects. Sep 09 03:38:15 devstack cinder-volume[86753]: If you are already using Eventlet, we recommend migrating to a different Sep 09 03:38:15 devstack cinder-volume[86753]: framework. For more detail see Sep 09 03:38:15 devstack cinder-volume[86753]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 03:38:15 devstack cinder-volume[86753]: import eventlet # noqa Sep 09 03:38:17 devstack cinder-volume[86753]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 03:38:17 devstack cinder-volume[86753]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 03:38:17 devstack cinder-volume[86753]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 03:38:18 devstack cinder-volume[86753]: INFO dbcounter [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Registered counter for database cinder Sep 09 03:38:18 devstack cinder-volume[86753]: DEBUG oslo_db.sqlalchemy.engines [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:38:18 devstack cinder-volume[86753]: DEBUG dbcounter [-] [86753] Writer thread running {{(pid=86753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 03:38:18 devstack cinder-volume[86753]: INFO cinder.rpc [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 03:38:18 devstack cinder-volume[86753]: INFO cinder.rpc [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 03:38:18 devstack cinder-volume[86753]: DEBUG oslo_db.sqlalchemy.engines [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:38:19 devstack cinder-volume[86753]: INFO cinder.volume.manager [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Determined volume DB was empty at startup. Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG cinder.volume.manager [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86753) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 03:38:19 devstack cinder-volume[86753]: INFO cinder.volume.manager [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 03:38:19 devstack cinder-volume[86753]: WARNING stevedore.named [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 03:38:19 devstack cinder-volume[86753]: WARNING castellan.key_manager [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 03:38:19 devstack cinder-volume[86753]: WARNING cinder.keymgr.conf_key_mgr [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 03:38:19 devstack cinder-volume[86753]: INFO cinder.volume.manager [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_db.sqlalchemy.engines [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:38:19 devstack cinder-volume[86753]: INFO oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Starting 1 workers Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Started child 86971 {{(pid=86753) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Full set of CONF: {{(pid=86753) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] ******************************************************************************** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Configuration options gathered from: {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] ================================================================================ {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] allow_availability_zone_fallback = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] allow_compression_on_image_upload = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] allowed_direct_url_schemes = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86971]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] api_rate_limit = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] auth_strategy = keystone {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_availability_zone = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_host = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_stats_polling_interval = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backup_api_class = cinder.backup.api.API {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backup_name_template = backup-%s {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backup_use_same_host = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backup_use_temp_snapshot = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] chap_password = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] chap_username = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_internal_tenant_project_id = acaffa7c685849e3948d13def08b0b72 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_internal_tenant_user_id = 2a37f7b86d294bf9b0a54fe0783a9e8a {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cluster = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] compression_format = gzip {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] config_dir = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] config_source = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] control_exchange = openstack {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] debug = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] default_availability_zone = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] default_group_type = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] default_volume_type = QuobyteHD {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] disk_geometry = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] driver_client_cert = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] driver_client_cert_key = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] driver_data_namespace = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] driver_ssl_cert_path = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] driver_ssl_cert_verify = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] driver_use_ssl = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] enable_new_services = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] enable_unsupported_driver = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] enforce_multipath_for_image_xfer = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] filter_function = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_api_insecure = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_api_servers = ['http://192.168.122.49/image'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_api_ssl_compression = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_ca_certificates_file = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_certfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_keyfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_num_retries = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance_request_timeout = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] goodness_function = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] graceful_shutdown_timeout = 5 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] group_api_class = cinder.group.api.API {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] host = devstack {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_compress_on_upload = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_conversion_address_space_limit = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_conversion_cpu_limit = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_conversion_disable = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_upload_use_cinder_backend = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_upload_use_internal_tenant = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_volume_cache_enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_volume_cache_max_count = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] init_host_max_objects_retrieval = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] instance_format = [instance: %(uuid)s] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] iscsi_target_flags = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] iscsi_write_cache = on {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] iser_helper = tgtadm {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] iser_ip_address = 192.168.122.49 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] iser_port = 3260 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_color = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_config_append = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_dir = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_file = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_options = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_rotate_interval = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_rotate_interval_type = days {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] log_rotation_type = none {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] max_age = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] max_logfile_count = 30 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] max_logfile_size_mb = 200 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] max_over_subscription_ratio = 20.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86971]: INFO cinder.volume.manager [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.remotefs [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86971) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] message_reap_interval = 86400 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] message_ttl = 2592000 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] monkey_patch = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] monkey_patch_modules = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] my_ip = 192.168.122.49 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] no_snapshot_gb_quota = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] num_iser_scan_tries = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] num_shell_tries = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] num_volume_device_scan_tries = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] nvmeof_conn_info_version = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] nvmet_ns_id = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] nvmet_port_id = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] osapi_max_limit = 1000 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] osapi_volume_ext_list = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] osapi_volume_listen_port = 8776 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] osapi_volume_use_ssl = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] osapi_volume_workers = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] per_volume_size_limit = -1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] periodic_fuzzy_delay = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] periodic_interval = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] public_endpoint = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] publish_errors = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] quota_backup_gigabytes = 1000 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] quota_backups = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] quota_gigabytes = 1000 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] quota_groups = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] quota_snapshots = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] quota_volumes = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] rate_limit_burst = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] rate_limit_except_level = CRITICAL {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] rate_limit_interval = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] reinit_driver_count = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] replication_device = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] report_discard_supported = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] report_interval = 120 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] reservation_clean_interval = 86400 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] reservation_expire = 86400 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] reserved_image_namespaces = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] reserved_percentage = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] rpc_response_timeout = 120 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] run_external_periodic_tasks = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] scst_target_driver = iscsi {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] scst_target_iqn_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_down_time = 720 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] shell_completion = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] snapshot_name_template = snapshot-%s {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] split_loggers = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] state_path = /opt/stack/data/cinder {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] storage_availability_zone = nova {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] storage_protocol = iSCSI {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] syslog_log_facility = LOG_USER {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] target_helper = lioadm {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] target_ip_address = 192.168.122.49 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] target_port = 3260 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] target_protocol = iscsi {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] target_secondary_ip_addresses = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] trace_flags = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] transport_url = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] until_refresh = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] use_chap_auth = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] use_default_quota_class = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] use_journal = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] use_json = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] use_multipath_for_image_xfer = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] use_stderr = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] use_syslog = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] verify_glance_signatures = enabled {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_api_class = cinder.volume.api.API {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_backend_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_clear = zero {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_clear_ionice = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_clear_size = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_copy_bps_limit = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_dd_blocksize = 1M {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_name_template = volume-%s {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_service_inithost_offload = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volume_usage_audit_period = month {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] zoning_mode = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.auth_section = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.auth_type = password {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.auth_version = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.cache = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.certfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.insecure = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.interface = public {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.keyfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_password = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcache_username = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.region_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.service_type = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.49/identity {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.backend = dogpile.cache.null {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.backend_argument = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.backend_expiration_time = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.config_prefix = cache.oslo {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.debug_cache_backend = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.enable_retry_client = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.enable_socket_keepalive = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.expiration_time = 600 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.memcache_dead_retry = 300 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.memcache_sasl_enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.password = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.proxies = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.redis_db = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.redis_server = localhost:6379 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.retry_attempts = 2 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.retry_delay = 0.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.socket_keepalive_count = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.socket_keepalive_idle = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.socket_keepalive_interval = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.socket_timeout = 1.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.tls_allowed_ciphers = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.tls_cafile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.tls_certfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86971) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 03:38:19 devstack cinder-volume[86971]: WARNING cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 03:38:19 devstack cinder-volume[86971]: WARNING cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.tls_enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.tls_keyfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cache.username = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] coordination.backend_url = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.asyncio_connection = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.asyncio_slave_connection = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.backend = sqlalchemy {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.connection = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.connection_debug = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.connection_parameters = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.connection_recycle_time = 3600 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.connection_trace = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.db_inc_retry_interval = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.db_max_retries = 20 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.db_max_retry_interval = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.db_retry_interval = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.max_overflow = 50 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.max_pool_size = 5 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.max_retries = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.pool_timeout = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.retry_interval = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.slave_connection = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.sqlite_synchronous = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.synchronous_reader = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Running cmd (subprocess): mount.quobyte {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] database.use_db_reconnect = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_tracing.insecure = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.connection_string = messaging:// {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.es_doc_type = notification {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.es_scroll_size = 10000 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.es_scroll_time = 2m {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.filter_error_trace = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.hmac_keys = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.sentinel_service_name = mymaster {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.socket_timeout = 0.1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.trace_requests = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler.trace_sqlalchemy = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler_jaeger.process_tags = {} {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] profiler_otlp.service_name_prefix = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.policy_default_rule = default {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] privsep_osbrick.group = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] privsep_osbrick.helper_command = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] privsep_osbrick.user = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_sys_admin.group = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_sys_admin.helper_command = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] cinder_sys_admin.user = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.auth_section = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.auth_type = password {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.cafile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.certfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.collect_timing = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.insecure = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.keyfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.send_service_user_token = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.split_loggers = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.timeout = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.tls_ciphers = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] service_user.tls_min_version = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.auth_section = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.auth_type = password {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.certfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.collect_timing = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.insecure = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.keyfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.region_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.split_loggers = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.timeout = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.tls_ciphers = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] glance.tls_min_version = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.backend_availability_zone = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.chap_password = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.chap_username = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.disk_geometry = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.driver_client_cert = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.driver_data_namespace = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.driver_use_ssl = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.extra_capabilities = {} {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.filter_function = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.goodness_function = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.iscsi_target_flags = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.iser_ip_address = 192.168.122.49 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.iser_port = 3260 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_host = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_login = admin {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_mount_options = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_password = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_private_key = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_share_path = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.replication_device = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.report_discard_supported = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.target_helper = tgtadm {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.target_ip_address = 192.168.122.49 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.target_port = 3260 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.target_protocol = iscsi {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.trace_flags = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.use_chap_auth = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volume_backend_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volume_clear = zero {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_reports.file_event_handler = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_reports.log_dir = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.backend_host = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.chap_password = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.chap_username = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.disk_geometry = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.driver_client_cert = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.extra_capabilities = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.filter_function = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.goodness_function = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.iser_helper = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.iser_ip_address = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.iser_port = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_host = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_login = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_mount_options = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_password = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_private_key = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_share_path = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.num_shell_tries = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.replication_device = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.report_discard_supported = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.reserved_percentage = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.scst_target_driver = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.storage_protocol = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.target_helper = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.target_ip_address = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.target_port = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.target_prefix = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.target_protocol = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.trace_flags = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.use_chap_auth = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volume_clear = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volume_clear_size = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] QuobyteHD.volumes_dir = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_notifications.driver = [] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] key_manager.fixed_key = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.barbican_api_version = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.barbican_endpoint = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.barbican_endpoint_type = public {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.barbican_region_name = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.cafile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.certfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.collect_timing = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.insecure = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.keyfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.number_of_retries = 60 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.retry_delay = 1 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.send_service_user_token = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.split_loggers = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.timeout = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.tls_ciphers = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.tls_min_version = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.verify_ssl = True {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican.verify_ssl_path = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.auth_section = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.auth_type = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.cafile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.certfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.collect_timing = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.insecure = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.keyfile = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.split_loggers = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.timeout = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.tls_ciphers = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] barbican_service_user.tls_min_version = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.approle_role_id = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.approle_secret_id = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.auth_method = approle {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.auth_path = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.kv_mountpoint = secret {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.kv_path = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.kv_version = 2 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.namespace = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.root_token_id = **** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.ssl_ca_crt_file = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.timeout = 60.0 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.token_file = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.token_role = None {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.use_ssl = False {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:19 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] ******************************************************************************** {{(pid=86753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 03:38:19 devstack quobyte-client[86974]: Reading configuration file: /etc/quobyte/client.cfg Sep 09 03:38:19 devstack quobyte-client[86974]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] CMD "mount.quobyte" returned: 1 in 0.155s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=86971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:38:19 devstack cinder-volume[86971]: INFO cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f ... Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b -c /etc/quobyte/client-cinder.cfg {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:19 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b -c /etc/quobyte/client-cinder.cfg Sep 09 03:38:19 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:19 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.380s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:19 devstack cinder-volume[86971]: INFO cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f succeeded Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=86971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.391s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:38:19 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:19 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:38:19 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:20 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.237s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:20 devstack cinder-volume[86971]: INFO cinder.volume.driver [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Driver hasn't implemented _init_vendor_properties() Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.volume.driver [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4433860778809, 'free_capacity_gb': 1773.4433860778809, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86971) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_db.sqlalchemy.engines [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG dbcounter [-] [86971] Writer thread running {{(pid=86971) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.db.api [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Building query based on filter {{(pid=86971) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.image.image_utils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86971) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 03:38:20 devstack cinder-volume[86971]: INFO cinder.keymgr.migration [None req-a40bc691-5a11-45e3-8dbe-40d2c6222392 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=86971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=86971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:20 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:38:20 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:20 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.233s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.manager [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Notifying Schedulers of capabilities ... {{(pid=86971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:38:20 devstack cinder-volume[86971]: INFO cinder.volume.manager [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Driver initialization completed successfully. Sep 09 03:38:20 devstack cinder-volume[86971]: INFO cinder.manager [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Initiating service 3 cleanup Sep 09 03:38:20 devstack cinder-volume[86971]: INFO cinder.manager [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Service 3 cleanup completed. Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.service [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Creating RPC server for service cinder-volume {{(pid=86971) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.service [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86971) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 03:38:20 devstack cinder-volume[86971]: INFO cinder.volume.manager [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=86971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=86971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:20 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:38:20 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:20 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:20 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.261s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:20 devstack cinder-volume[86971]: INFO cinder.volume.manager [None req-151f25b3-f7bb-4b7d-bcb2-8f420ef141bb None None] Driver post RPC initialization completed successfully. Sep 09 03:38:25 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:38:25 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:38:25 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=86971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:38:25 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=86971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:38:25 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:38:25 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:25 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:38:25 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:25 devstack cinder-volume[86753]: INFO oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Caught SIGTERM, stopping children Sep 09 03:38:25 devstack cinder-volume[86753]: DEBUG oslo_concurrency.lockutils [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Acquiring lock "singleton_lock" {{(pid=86753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 03:38:25 devstack cinder-volume[86753]: DEBUG oslo_concurrency.lockutils [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Acquired lock "singleton_lock" {{(pid=86753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 03:38:25 devstack cinder-volume[86753]: DEBUG oslo_concurrency.lockutils [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Releasing lock "singleton_lock" {{(pid=86753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 03:38:25 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Stop services. {{(pid=86753) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 03:38:25 devstack cinder-volume[86753]: DEBUG oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Killing children. {{(pid=86753) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 03:38:25 devstack cinder-volume[86753]: INFO oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Waiting on 1 children to exit Sep 09 03:38:25 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:25 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.317s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:25 devstack cinder-volume[86971]: DEBUG cinder.manager [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Notifying Schedulers of capabilities ... {{(pid=86971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Unable to connect to AMQP server on 192.168.122.49:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server [None req-3711790e-2021-4d34-9026-975bd9a7506f None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.49:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server method() Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return _publish( Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server listener(*args) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.49:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 09 03:38:25 devstack cinder-volume[86971]: ERROR oslo_messaging.rpc.server Sep 09 03:38:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Acquiring lock "singleton_lock" {{(pid=86971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 03:38:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Acquired lock "singleton_lock" {{(pid=86971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 03:38:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Releasing lock "singleton_lock" {{(pid=86971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 03:38:28 devstack cinder-volume[86971]: WARNING amqp [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 03:38:28 devstack cinder-volume[86971]: WARNING amqp [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 03:38:28 devstack cinder-volume[86753]: INFO oslo_service.backend._eventlet.service [None req-35a27619-d5c3-454f-8797-7c0fdf6367c1 None None] Child 86971 exited with status 0 Sep 09 03:38:29 devstack cinder-volume[87297]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 03:38:29 devstack cinder-volume[87297]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 03:38:29 devstack cinder-volume[87297]: we strongly recommend against using it for new projects. Sep 09 03:38:29 devstack cinder-volume[87297]: If you are already using Eventlet, we recommend migrating to a different Sep 09 03:38:29 devstack cinder-volume[87297]: framework. For more detail see Sep 09 03:38:29 devstack cinder-volume[87297]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 03:38:29 devstack cinder-volume[87297]: import eventlet # noqa Sep 09 03:38:32 devstack cinder-volume[87297]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 03:38:32 devstack cinder-volume[87297]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 03:38:32 devstack cinder-volume[87297]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 03:38:33 devstack cinder-volume[87297]: INFO dbcounter [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Registered counter for database cinder Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_db.sqlalchemy.engines [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG dbcounter [-] [87297] Writer thread running {{(pid=87297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 03:38:33 devstack cinder-volume[87297]: INFO cinder.rpc [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 03:38:33 devstack cinder-volume[87297]: INFO cinder.rpc [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_db.sqlalchemy.engines [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:38:33 devstack cinder-volume[87297]: INFO cinder.volume.manager [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Determined volume DB was empty at startup. Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG cinder.volume.manager [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87297) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 03:38:33 devstack cinder-volume[87297]: WARNING stevedore.named [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 03:38:33 devstack cinder-volume[87297]: WARNING castellan.key_manager [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 03:38:33 devstack cinder-volume[87297]: WARNING cinder.keymgr.conf_key_mgr [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 03:38:33 devstack cinder-volume[87297]: INFO cinder.volume.manager [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_db.sqlalchemy.engines [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:38:33 devstack cinder-volume[87297]: INFO oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Starting 1 workers Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Started child 87597 {{(pid=87297) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Full set of CONF: {{(pid=87297) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] ******************************************************************************** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] Configuration options gathered from: {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] ================================================================================ {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] allow_availability_zone_fallback = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] allow_compression_on_image_upload = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87597]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] allowed_direct_url_schemes = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] api_rate_limit = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] auth_strategy = keystone {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_availability_zone = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_host = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_stats_polling_interval = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backup_api_class = cinder.backup.api.API {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backup_name_template = backup-%s {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backup_use_same_host = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backup_use_temp_snapshot = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] chap_password = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] chap_username = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_internal_tenant_project_id = acaffa7c685849e3948d13def08b0b72 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_internal_tenant_user_id = 2a37f7b86d294bf9b0a54fe0783a9e8a {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cluster = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] compression_format = gzip {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] compute_api_class = cinder.compute.nova.API {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] config_dir = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] config_source = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] control_exchange = openstack {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] debug = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] default_availability_zone = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] default_group_type = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] default_volume_type = QuobyteHD {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] disk_geometry = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] driver_client_cert = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] driver_client_cert_key = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] driver_data_namespace = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] driver_ssl_cert_path = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] driver_ssl_cert_verify = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] driver_use_ssl = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] enable_new_services = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] enable_unsupported_driver = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] enabled_backends = ['QuobyteHD'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] enforce_multipath_for_image_xfer = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] filter_function = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_api_insecure = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_api_servers = ['http://192.168.122.49/image'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_api_ssl_compression = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_ca_certificates_file = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_catalog_info = image:glance:publicURL {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_certfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_keyfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_num_retries = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance_request_timeout = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] goodness_function = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] graceful_shutdown_timeout = 5 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] group_api_class = cinder.group.api.API {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] host = devstack {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_compress_on_upload = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_conversion_address_space_limit = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_conversion_cpu_limit = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_conversion_disable = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_upload_use_cinder_backend = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_upload_use_internal_tenant = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_volume_cache_enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_volume_cache_max_count = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] image_volume_cache_max_size_gb = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] init_host_max_objects_retrieval = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] instance_format = [instance: %(uuid)s] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] iscsi_target_flags = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] iscsi_write_cache = on {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] iser_helper = tgtadm {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] iser_ip_address = 192.168.122.49 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] iser_port = 3260 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_color = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_config_append = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_dir = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_file = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_options = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_rotate_interval = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_rotate_interval_type = days {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] log_rotation_type = none {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] max_age = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] max_logfile_count = 30 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] max_logfile_size_mb = 200 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] max_over_subscription_ratio = 20.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] message_reap_interval = 86400 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] message_ttl = 2592000 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] migration_create_volume_timeout_secs = 300 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] monkey_patch = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] monkey_patch_modules = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] my_ip = 192.168.122.49 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] no_snapshot_gb_quota = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] num_iser_scan_tries = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] num_shell_tries = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] num_volume_device_scan_tries = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] nvmeof_conn_info_version = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] nvmet_ns_id = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] nvmet_port_id = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] osapi_max_limit = 1000 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] osapi_volume_ext_list = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] osapi_volume_listen_port = 8776 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] osapi_volume_use_ssl = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] osapi_volume_workers = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] per_volume_size_limit = -1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] periodic_fuzzy_delay = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] periodic_interval = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] public_endpoint = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] publish_errors = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] quota_backup_gigabytes = 1000 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] quota_backups = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] quota_gigabytes = 1000 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] quota_groups = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] quota_snapshots = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] quota_volumes = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] rate_limit_burst = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] rate_limit_except_level = CRITICAL {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] rate_limit_interval = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] reinit_driver_count = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] replication_device = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87597) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] report_discard_supported = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] report_interval = 120 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] reservation_clean_interval = 86400 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] reservation_expire = 86400 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] reserved_image_namespaces = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] reserved_percentage = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] rpc_response_timeout = 120 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] run_external_periodic_tasks = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] scst_target_driver = iscsi {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] scst_target_iqn_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_down_time = 720 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] shell_completion = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] snapshot_name_template = snapshot-%s {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] split_loggers = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] state_path = /opt/stack/data/cinder {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] storage_availability_zone = nova {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] storage_protocol = iSCSI {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] syslog_log_facility = LOG_USER {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] target_helper = lioadm {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] target_ip_address = 192.168.122.49 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] target_port = 3260 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] target_protocol = iscsi {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] target_secondary_ip_addresses = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] trace_flags = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] transport_url = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] until_refresh = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] use_chap_auth = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] use_default_quota_class = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] use_journal = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] use_json = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] use_multipath_for_image_xfer = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] use_stderr = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] use_syslog = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] verify_glance_signatures = enabled {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_api_class = cinder.volume.api.API {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_backend_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_clear = zero {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_clear_ionice = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_clear_size = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_copy_bps_limit = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_dd_blocksize = 1M {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_name_template = volume-%s {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_service_inithost_offload = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volume_usage_audit_period = month {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] zoning_mode = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_concurrency.disable_process_locking = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.auth_section = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.auth_type = password {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.auth_version = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.cache = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.certfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.include_service_catalog = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.insecure = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.interface = public {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.keyfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_password = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcache_username = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.region_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.service_type = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.49/identity {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.backend = dogpile.cache.null {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.backend_argument = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.backend_expiration_time = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.config_prefix = cache.oslo {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.debug_cache_backend = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.enable_retry_client = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.enable_socket_keepalive = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.expiration_time = 600 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.hashclient_retry_attempts = 2 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.memcache_dead_retry = 300 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.memcache_pool_maxsize = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.memcache_sasl_enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.password = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.proxies = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.redis_db = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.redis_server = localhost:6379 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.retry_attempts = 2 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.retry_delay = 0.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.socket_keepalive_count = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.socket_keepalive_idle = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.socket_keepalive_interval = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.socket_timeout = 1.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.tls_allowed_ciphers = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.tls_cafile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.tls_certfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.tls_enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.tls_keyfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cache.username = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] coordination.backend_url = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.asyncio_connection = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.asyncio_slave_connection = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.backend = sqlalchemy {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.connection = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.connection_debug = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.connection_parameters = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.connection_recycle_time = 3600 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.connection_trace = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.db_inc_retry_interval = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.db_max_retries = 20 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.db_max_retry_interval = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.db_retry_interval = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.max_overflow = 50 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.max_pool_size = 5 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.max_retries = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.mysql_wsrep_sync_wait = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.pool_timeout = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.retry_interval = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.slave_connection = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.sqlite_synchronous = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.synchronous_reader = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] database.use_db_reconnect = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_tracing.insecure = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.connection_string = messaging:// {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.es_doc_type = notification {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.es_scroll_size = 10000 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.es_scroll_time = 2m {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.filter_error_trace = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.hmac_keys = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.sentinel_service_name = mymaster {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.socket_timeout = 0.1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.trace_requests = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler.trace_sqlalchemy = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler_jaeger.process_tags = {} {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler_jaeger.service_name_prefix = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] profiler_otlp.service_name_prefix = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.enforce_new_defaults = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.policy_default_rule = default {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.policy_file = policy.yaml {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:33 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] privsep_osbrick.group = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] privsep_osbrick.helper_command = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] privsep_osbrick.user = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_sys_admin.group = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_sys_admin.helper_command = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] cinder_sys_admin.user = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.auth_section = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.auth_type = password {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.cafile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.certfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.collect_timing = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.insecure = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.keyfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.send_service_user_token = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.split_loggers = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.timeout = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.tls_ciphers = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] service_user.tls_min_version = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.auth_section = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.auth_type = password {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.certfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.collect_timing = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.insecure = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.keyfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.region_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.split_loggers = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.timeout = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.tls_ciphers = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] glance.tls_min_version = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.backend_availability_zone = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.chap_password = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.chap_username = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.disk_geometry = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.driver_client_cert = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87597) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 03:38:34 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 03:38:34 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.driver_client_cert_key = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Running cmd (subprocess): mount.quobyte {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.driver_data_namespace = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.driver_use_ssl = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.extra_capabilities = {} {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.filter_function = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.goodness_function = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.iscsi_target_flags = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.iscsi_write_cache = on {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.iser_helper = tgtadm {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.iser_ip_address = 192.168.122.49 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.iser_port = 3260 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_host = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_login = admin {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_mount_options = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_password = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_private_key = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_share_path = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.num_shell_tries = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.quobyte_volume_url = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.replication_device = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.report_discard_supported = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.reserved_percentage = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.target_helper = tgtadm {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.target_ip_address = 192.168.122.49 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.target_port = 3260 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.target_protocol = iscsi {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.trace_flags = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.unique_fqdn_network = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.use_chap_auth = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volume_backend_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volume_clear = zero {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volume_clear_ionice = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volume_clear_size = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_reports.file_event_handler = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_reports.log_dir = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.backend_availability_zone = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.backend_host = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.chap_password = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.chap_username = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.chiscsi_conf = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.disk_geometry = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.driver_client_cert = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.driver_data_namespace = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.driver_use_ssl = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.extra_capabilities = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.filter_function = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.goodness_function = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.iser_helper = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.iser_ip_address = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.iser_port = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.iser_target_prefix = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_host = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_login = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_mount_options = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_password = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_private_key = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_share_path = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_ssh_port = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.num_shell_tries = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.nvmet_port_id = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.replication_device = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.report_discard_supported = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.reserved_percentage = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.scst_target_driver = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.storage_protocol = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.target_helper = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.target_ip_address = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.target_port = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.target_prefix = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.target_protocol = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.trace_flags = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.use_chap_auth = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volume_clear = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volume_clear_size = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] QuobyteHD.volumes_dir = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.ssl = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_notifications.driver = [] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_notifications.retry = -1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack quobyte-client[87599]: Reading configuration file: /etc/quobyte/client.cfg Sep 09 03:38:34 devstack quobyte-client[87599]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] key_manager.fixed_key = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.barbican_api_version = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.barbican_endpoint = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.barbican_endpoint_type = public {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.barbican_region_name = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.cafile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.certfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.collect_timing = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.insecure = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.keyfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.number_of_retries = 60 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.retry_delay = 1 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.send_service_user_token = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.split_loggers = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.timeout = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.tls_ciphers = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.tls_min_version = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.verify_ssl = True {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican.verify_ssl_path = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.auth_section = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.auth_type = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.cafile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.certfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.collect_timing = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.insecure = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.keyfile = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.split_loggers = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.timeout = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.tls_ciphers = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] barbican_service_user.tls_min_version = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.approle_role_id = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.approle_secret_id = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.auth_method = approle {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.auth_path = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.kv_mountpoint = secret {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.kv_path = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.kv_version = 2 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.namespace = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.root_token_id = **** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.ssl_ca_crt_file = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.timeout = 60.0 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.token_file = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.token_role = None {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.use_ssl = False {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 03:38:34 devstack cinder-volume[87297]: DEBUG oslo_service.backend._eventlet.service [None req-83e085e7-a647-4143-8779-75ea68620a55 None None] ******************************************************************************** {{(pid=87297) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 03:38:34 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:38:34 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:34 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.253s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:34 devstack cinder-volume[87597]: INFO cinder.volume.driver [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.volume.driver [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4433860778809, 'free_capacity_gb': 1773.4433860778809, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87597) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_db.sqlalchemy.engines [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writer thread running {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.db.api [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Building query based on filter {{(pid=87597) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87597) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:34 devstack cinder-volume[87597]: INFO cinder.keymgr.migration [None req-69e6caa2-ae38-4048-9d44-9e052d486ada None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 03:38:34 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:38:34 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:34 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.248s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:38:34 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Driver initialization completed successfully. Sep 09 03:38:34 devstack cinder-volume[87597]: INFO cinder.manager [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Initiating service 3 cleanup Sep 09 03:38:34 devstack cinder-volume[87597]: INFO cinder.manager [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Service 3 cleanup completed. Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.service [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Creating RPC server for service cinder-volume {{(pid=87597) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.service [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87597) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 03:38:34 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:38:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:38:35 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:38:35 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:38:35 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Sep 09 03:38:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.238s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:38:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6049bd34-fd71-4fba-b36f-8b8a68877fd5 None None] Driver post RPC initialization completed successfully. Sep 09 03:38:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:38:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 6 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:38:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:38:43 devstack cinder-volume[87297]: DEBUG dbcounter [-] [87297] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:38:44 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:38:45 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=4 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:39:37 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:39:37 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:39:37 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.562s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 6 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:39:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Flow 'volume_create_manager' (bcea0004-7851-4e00-b50d-2b55a825ab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eab320-7785-4e5d-8a03-1ba9e76c8c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eab320-7785-4e5d-8a03-1ba9e76c8c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1100103099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca400d5-d0a7-476d-9163-305e936980fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566a73bb4a448a3a1dd38dcda498e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:39:56Z,use_quota=True,user_id='8619aa96706e4603ab6e7b508630cb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc98e6f5-c2a1-4bf1-9452-c2eef44cdd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc98e6f5-c2a1-4bf1-9452-c2eef44cdd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953e600f-8df2-41f9-a879-0f953c0b16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953e600f-8df2-41f9-a879-0f953c0b16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca400d5-d0a7-476d-9163-305e936980fb', 'volume_name': 'volume-bca400d5-d0a7-476d-9163-305e936980fb', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55983b7-c697-4ffe-876f-9fb9b2f3f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:39:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55983b7-c697-4ffe-876f-9fb9b2f3f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d3501d-b987-4fef-b522-51843b0d642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:39:57 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Volume bca400d5-d0a7-476d-9163-305e936980fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca400d5-d0a7-476d-9163-305e936980fb', 'volume_size': 1} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1100103099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca400d5-d0a7-476d-9163-305e936980fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8566a73bb4a448a3a1dd38dcda498e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:39:56Z,use_quota=True,user_id='8619aa96706e4603ab6e7b508630cb64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Creating volume bca400d5-d0a7-476d-9163-305e936980fb {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:39:57 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:39:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:39:57 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb 1073741824 Sep 09 03:39:57 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:39:58 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Sep 09 03:39:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb 1073741824" returned: 0 in 1.145s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:39:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:39:58 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb Sep 09 03:39:58 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:39:58 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Sep 09 03:39:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb" returned: 0 in 0.579s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:39:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:39:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:39:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d3501d-b987-4fef-b522-51843b0d642d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca400d5-d0a7-476d-9163-305e936980fb', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:39:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5cbad0-2bcd-4887-9bbc-1fde382bd508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:39:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Volume volume-bca400d5-d0a7-476d-9163-305e936980fb (bca400d5-d0a7-476d-9163-305e936980fb): created successfully Sep 09 03:39:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5cbad0-2bcd-4887-9bbc-1fde382bd508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:39:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Flow 'volume_create_manager' (bcea0004-7851-4e00-b50d-2b55a825ab03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:39:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b407f2b3-3cb0-48b3-9a12-9421c7a43a2f tempest-VolumesAdminNegativeTest-485091448 None] Created volume successfully. Sep 09 03:39:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Acquiring lock "cinder-bca400d5-d0a7-476d-9163-305e936980fb-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:39:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Lock "cinder-bca400d5-d0a7-476d-9163-305e936980fb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:39:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Acquiring lock "cinder-quobyte-bca400d5-d0a7-476d-9163-305e936980fb" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:39:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Lock "cinder-quobyte-bca400d5-d0a7-476d-9163-305e936980fb" acquired by "delete_volume" :: waited 0.038s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:39:59 devstack cinder-volume[87597]: INFO oslo.privsep.daemon [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0t_umlss/privsep.sock'] Sep 09 03:39:59 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0t_umlss/privsep.sock Sep 09 03:39:59 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 03:40:01 devstack cinder-volume[87597]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 09 03:40:02 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:02 devstack cinder-volume[87597]: INFO oslo.privsep.daemon [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Spawned new privsep daemon via rootwrap Sep 09 03:40:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Accepted privsep connection to /tmp/tmp0t_umlss/privsep.sock {{(pid=87597) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 09 03:40:02 devstack cinder-volume[87597]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 09 03:40:02 devstack cinder-volume[87597]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 09 03:40:02 devstack cinder-volume[87597]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 09 03:40:02 devstack cinder-volume[87597]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88854 Sep 09 03:40:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[608e1d07-e6aa-4cd7-9972-3d2e3c3af67a]: (2,) {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:40:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[65532aaf-f20f-4cb7-a3a6-700e22956b37]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:40:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:02 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb Sep 09 03:40:02 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:02 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb" returned: 0 in 0.444s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:02 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb Sep 09 03:40:02 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:03 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bca400d5-d0a7-476d-9163-305e936980fb" returned: 0 in 0.456s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Lock "cinder-quobyte-bca400d5-d0a7-476d-9163-305e936980fb" released by "delete_volume" :: held 3.399s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:40:03 devstack cinder-volume[87597]: WARNING cinder.quota [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:40:03 devstack cinder-volume[87597]: WARNING cinder.quota [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Created reservations ['ad6482c5-ccd0-4023-9cd2-a1cb024471c4', 'c074e7e4-8dd5-40bb-b9e2-153c2dddef1c', '71f9392a-cf99-47b9-817d-521f8443ee4b', 'e90e7943-e5d5-4279-aae2-92134de85d8a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:03 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:40:03 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:04 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.387s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:04 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:40:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Deleted volume successfully. Sep 09 03:40:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0bd8e0e5-65a9-4ec7-a7e8-83b708a608f6 tempest-VolumesAdminNegativeTest-485091448 None] Lock "cinder-bca400d5-d0a7-476d-9163-305e936980fb-delete_volume" released by "delete_volume" :: held 4.500s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Flow 'volume_create_manager' (60ea7081-130e-4c49-9ded-d903352b643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6507f139-3834-4297-93a5-a602c74058bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6507f139-3834-4297-93a5-a602c74058bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2022675066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36520b7f-18d8-4785-932f-365d1e26ef96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073e324a0a7c4584b9e91a93b0ecd3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:40:11Z,use_quota=True,user_id='a42a47e5d9e04ce58e3b00838b4f1095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2eac99-27f2-46d2-b1c7-11c46b9ef88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2eac99-27f2-46d2-b1c7-11c46b9ef88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cb6859-1ee2-41da-85c5-228ca601f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cb6859-1ee2-41da-85c5-228ca601f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36520b7f-18d8-4785-932f-365d1e26ef96', 'volume_name': 'volume-36520b7f-18d8-4785-932f-365d1e26ef96', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad228ca4-4fa9-42a4-819e-e3bf9b0987da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad228ca4-4fa9-42a4-819e-e3bf9b0987da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2db73e-9838-4490-8532-8a624dc691d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:11 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Volume 36520b7f-18d8-4785-932f-365d1e26ef96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36520b7f-18d8-4785-932f-365d1e26ef96', 'volume_size': 1} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2022675066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36520b7f-18d8-4785-932f-365d1e26ef96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073e324a0a7c4584b9e91a93b0ecd3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:40:11Z,use_quota=True,user_id='a42a47e5d9e04ce58e3b00838b4f1095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Creating volume 36520b7f-18d8-4785-932f-365d1e26ef96 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:40:11 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:40:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:11 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 1073741824 Sep 09 03:40:11 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:12 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 1073741824" returned: 0 in 0.751s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:12 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 Sep 09 03:40:12 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:12 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96" returned: 0 in 0.353s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2db73e-9838-4490-8532-8a624dc691d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36520b7f-18d8-4785-932f-365d1e26ef96', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91cbabf-f73d-4587-971f-3f27463e77e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:12 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Volume volume-36520b7f-18d8-4785-932f-365d1e26ef96 (36520b7f-18d8-4785-932f-365d1e26ef96): created successfully Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91cbabf-f73d-4587-971f-3f27463e77e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Flow 'volume_create_manager' (60ea7081-130e-4c49-9ded-d903352b643f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:40:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b39681f7-5f39-448c-94f5-86885c4449c4 tempest-AttachVolumeTestJSON-1802340450 None] Created volume successfully. Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Flow 'volume_create_manager' (662a4fb0-53c2-450a-9606-f519b341b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f680e59-6808-4684-a095-7063792d8945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f680e59-6808-4684-a095-7063792d8945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1641614494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d7c477-1ec1-44d9-ad5e-6966eeb3822c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0228d686768c4394b655af847f2db275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:40:13Z,use_quota=True,user_id='b53e6cb6b29949a1944fde6818badc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc518378-d28f-4b2f-bf9a-820a597f0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc518378-d28f-4b2f-bf9a-820a597f0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d354b9e3-a980-416d-b975-53f4be0fcae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d354b9e3-a980-416d-b975-53f4be0fcae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d7c477-1ec1-44d9-ad5e-6966eeb3822c', 'volume_name': 'volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7449a4ee-a209-4632-8d53-25c65892f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7449a4ee-a209-4632-8d53-25c65892f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759deae4-0a99-484e-a858-5272b0922727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:12 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Volume 33d7c477-1ec1-44d9-ad5e-6966eeb3822c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c', 'volume_size': 1} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1641614494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d7c477-1ec1-44d9-ad5e-6966eeb3822c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0228d686768c4394b655af847f2db275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:40:13Z,use_quota=True,user_id='b53e6cb6b29949a1944fde6818badc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Creating volume 33d7c477-1ec1-44d9-ad5e-6966eeb3822c {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:40:12 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:40:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:13 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c 1073741824 Sep 09 03:40:13 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:13 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c 1073741824" returned: 0 in 0.528s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:13 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c Sep 09 03:40:13 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:13 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759deae4-0a99-484e-a858-5272b0922727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21f5a63-910b-4868-80a6-e2b628aee1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:13 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Volume volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c (33d7c477-1ec1-44d9-ad5e-6966eeb3822c): created successfully Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21f5a63-910b-4868-80a6-e2b628aee1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Flow 'volume_create_manager' (662a4fb0-53c2-450a-9606-f519b341b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:40:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c1aee447-956b-4d3e-aa1b-46ba14eedbf3 tempest-ServersNegativeTestJSON-1542719244 None] Created volume successfully. Sep 09 03:40:16 devstack cinder-volume[87597]: WARNING py.warnings [req-024fb012-05b4-4144-a670-5cd25b3dd4ab req-2d069396-8b4d-4264-96b0-b76fa24f57c4 tempest-AttachVolumeTestJSON-1802340450 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 09 03:40:16 devstack cinder-volume[87597]: .first() Sep 09 03:40:16 devstack cinder-volume[87597]: Sep 09 03:40:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-024fb012-05b4-4144-a670-5cd25b3dd4ab req-2d069396-8b4d-4264-96b0-b76fa24f57c4 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-024fb012-05b4-4144-a670-5cd25b3dd4ab req-2d069396-8b4d-4264-96b0-b76fa24f57c4 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-024fb012-05b4-4144-a670-5cd25b3dd4ab req-2d069396-8b4d-4264-96b0-b76fa24f57c4 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-024fb012-05b4-4144-a670-5cd25b3dd4ab req-2d069396-8b4d-4264-96b0-b76fa24f57c4 tempest-AttachVolumeTestJSON-1802340450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-36520b7f-18d8-4785-932f-365d1e26ef96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96432b07-77cb-44f7-8f41-de5a9316719c', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:40:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-024fb012-05b4-4144-a670-5cd25b3dd4ab req-2d069396-8b4d-4264-96b0-b76fa24f57c4 tempest-AttachVolumeTestJSON-1802340450 None] attachment_update completed successfully. Sep 09 03:40:20 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Flow 'volume_create_manager' (1c1f9c7e-c0af-490d-9fd1-08eec2f0f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d27dc9-4673-4435-8b9e-656eed8e61ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d27dc9-4673-4435-8b9e-656eed8e61ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-755601184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba88546-2036-4c4e-b644-caa8db474918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0228d686768c4394b655af847f2db275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:40:21Z,use_quota=True,user_id='b53e6cb6b29949a1944fde6818badc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383623a9-a852-418d-8124-216300a96ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383623a9-a852-418d-8124-216300a96ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268171a9-3f64-4dec-bc6a-991441488f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268171a9-3f64-4dec-bc6a-991441488f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba88546-2036-4c4e-b644-caa8db474918', 'volume_name': 'volume-2ba88546-2036-4c4e-b644-caa8db474918', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b4ed54-1ec2-4b74-80a6-29d10225210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b4ed54-1ec2-4b74-80a6-29d10225210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849a067f-c5ba-4739-b31f-f99ed47b86a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:21 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Volume 2ba88546-2036-4c4e-b644-caa8db474918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba88546-2036-4c4e-b644-caa8db474918', 'volume_size': 1} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-755601184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba88546-2036-4c4e-b644-caa8db474918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0228d686768c4394b655af847f2db275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:40:21Z,use_quota=True,user_id='b53e6cb6b29949a1944fde6818badc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Creating volume 2ba88546-2036-4c4e-b644-caa8db474918 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:40:21 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:21 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 1073741824 Sep 09 03:40:21 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:21 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 1073741824" returned: 0 in 0.519s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:21 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 Sep 09 03:40:21 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:22 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918" returned: 0 in 0.382s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:40:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849a067f-c5ba-4739-b31f-f99ed47b86a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba88546-2036-4c4e-b644-caa8db474918', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cc2a02-e81d-4816-a67e-8e5f0eab8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:40:22 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Volume volume-2ba88546-2036-4c4e-b644-caa8db474918 (2ba88546-2036-4c4e-b644-caa8db474918): created successfully Sep 09 03:40:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cc2a02-e81d-4816-a67e-8e5f0eab8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:40:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Flow 'volume_create_manager' (1c1f9c7e-c0af-490d-9fd1-08eec2f0f257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:40:22 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-79067499-a2a5-4f05-aaf4-fd1c6c07c9e0 tempest-ServersNegativeTestJSON-1542719244 None] Created volume successfully. Sep 09 03:40:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "cinder-2ba88546-2036-4c4e-b644-caa8db474918-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:40:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Lock "cinder-2ba88546-2036-4c4e-b644-caa8db474918-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:40:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "cinder-quobyte-2ba88546-2036-4c4e-b644-caa8db474918" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:40:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Lock "cinder-quobyte-2ba88546-2036-4c4e-b644-caa8db474918" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:40:23 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdff240-2340-4f37-bbca-ac98fdd5d3d2]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:40:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:23 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 Sep 09 03:40:23 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:24 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918" returned: 0 in 0.410s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:24 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918 Sep 09 03:40:24 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:24 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2ba88546-2036-4c4e-b644-caa8db474918" returned: 0 in 0.492s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Lock "cinder-quobyte-2ba88546-2036-4c4e-b644-caa8db474918" released by "delete_volume" :: held 0.965s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Created reservations ['e56c3b07-b176-43c1-b836-23ef672fa85f', '42cd43c6-340c-4a61-96de-37c5347f5cc9', 'e8e61142-85e0-45ed-ac43-34cb2586b396', '4c1fa007-7e3e-4c6a-97ed-8fa5f1f7ecfa'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:24 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:40:24 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:25 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:25 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:40:25 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Deleted volume successfully. Sep 09 03:40:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cc26cabd-931e-48e7-a4d6-9e15333fcbb6 tempest-ServersNegativeTestJSON-1542719244 None] Lock "cinder-2ba88546-2036-4c4e-b644-caa8db474918-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:40:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "cinder-33d7c477-1ec1-44d9-ad5e-6966eeb3822c-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:40:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Lock "cinder-33d7c477-1ec1-44d9-ad5e-6966eeb3822c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:40:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "cinder-quobyte-33d7c477-1ec1-44d9-ad5e-6966eeb3822c" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:40:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Lock "cinder-quobyte-33d7c477-1ec1-44d9-ad5e-6966eeb3822c" acquired by "delete_volume" :: waited 0.041s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:40:26 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d50d87-d651-4ea3-a493-1c2a262c1e65]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:40:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:26 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c Sep 09 03:40:26 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:26 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c" returned: 0 in 0.676s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:27 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c Sep 09 03:40:27 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:27 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-33d7c477-1ec1-44d9-ad5e-6966eeb3822c" returned: 0 in 0.481s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Lock "cinder-quobyte-33d7c477-1ec1-44d9-ad5e-6966eeb3822c" released by "delete_volume" :: held 1.259s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Created reservations ['7aa20914-d3e1-444c-af8e-74282b8e6b24', '40f6a3d3-9ff8-4c71-983f-4fb9642632ea', 'a1058433-8a6c-4c0b-9c77-f2758eee7443', 'd3c37f14-f661-4a13-b28d-dbc848f7a470'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:27 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:40:27 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:28 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.516s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:28 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:40:28 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Deleted volume successfully. Sep 09 03:40:28 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-34c7cd24-d777-47dc-92ea-db8798e83744 tempest-ServersNegativeTestJSON-1542719244 None] Lock "cinder-33d7c477-1ec1-44d9-ad5e-6966eeb3822c-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:40:37 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:40:37 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:40:37 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.378s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 8 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:40:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:40:45 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=29,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:40:45 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=31,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:40:53 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-7509ab2a-13ff-44b1-97f4-7f65293f4397 req-c60264b9-3b3e-44f9-9425-bb04718395fb tempest-AttachVolumeTestJSON-1802340450 None] Terminate volume connection completed successfully. Sep 09 03:40:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-7509ab2a-13ff-44b1-97f4-7f65293f4397 req-c60264b9-3b3e-44f9-9425-bb04718395fb tempest-AttachVolumeTestJSON-1802340450 None] Deleting attachment 96432b07-77cb-44f7-8f41-de5a9316719c. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Flow 'volume_create_manager' (644fe069-3a75-454b-b1de-afee3cc5b763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289990e0-b1a7-4e66-89f7-4c679a4479a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289990e0-b1a7-4e66-89f7-4c679a4479a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2052780300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb964ae-ae1b-4ca4-9452-59e0915eed14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92e2564acf1406cb212ac5a0e584a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:41:03Z,use_quota=True,user_id='a0e37cefb6244675aa1f21ec9b290c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554ff25d-348a-4e35-8e62-633a58e6bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554ff25d-348a-4e35-8e62-633a58e6bf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9203b895-817b-40d7-b002-fcf7767b23d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9203b895-817b-40d7-b002-fcf7767b23d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb964ae-ae1b-4ca4-9452-59e0915eed14', 'volume_name': 'volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab33988-f772-4dc0-8b09-7a44f7698f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab33988-f772-4dc0-8b09-7a44f7698f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fd5a22-19f5-4575-a282-653261e65385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:03 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Volume ecb964ae-ae1b-4ca4-9452-59e0915eed14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14', 'volume_size': 1} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2052780300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb964ae-ae1b-4ca4-9452-59e0915eed14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a92e2564acf1406cb212ac5a0e584a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:41:03Z,use_quota=True,user_id='a0e37cefb6244675aa1f21ec9b290c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Creating volume ecb964ae-ae1b-4ca4-9452-59e0915eed14 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:41:03 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:41:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:03 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 1073741824 Sep 09 03:41:03 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:04 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 1073741824" returned: 0 in 1.124s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:04 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 Sep 09 03:41:04 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:04 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14" returned: 0 in 0.514s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fd5a22-19f5-4575-a282-653261e65385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e36d57-a061-4bc5-95c0-1c498361369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:04 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Volume volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 (ecb964ae-ae1b-4ca4-9452-59e0915eed14): created successfully Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e36d57-a061-4bc5-95c0-1c498361369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Flow 'volume_create_manager' (644fe069-3a75-454b-b1de-afee3cc5b763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:41:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-74f6674b-6e32-45f5-be2c-ef1e8fd247ef tempest-DeleteServersTestJSON-1273933714 None] Created volume successfully. Sep 09 03:41:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-9a3dce32-ea9f-4a53-8270-1b5ba6636672 req-ae309071-ca5c-41af-851c-fab0df1ac8ee tempest-DeleteServersTestJSON-1273933714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-9a3dce32-ea9f-4a53-8270-1b5ba6636672 req-ae309071-ca5c-41af-851c-fab0df1ac8ee tempest-DeleteServersTestJSON-1273933714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-9a3dce32-ea9f-4a53-8270-1b5ba6636672 req-ae309071-ca5c-41af-851c-fab0df1ac8ee tempest-DeleteServersTestJSON-1273933714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-9a3dce32-ea9f-4a53-8270-1b5ba6636672 req-ae309071-ca5c-41af-851c-fab0df1ac8ee tempest-DeleteServersTestJSON-1273933714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29e3836a-8ae4-406b-9219-71c1c7d6eb22', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:41:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-9a3dce32-ea9f-4a53-8270-1b5ba6636672 req-ae309071-ca5c-41af-851c-fab0df1ac8ee tempest-DeleteServersTestJSON-1273933714 None] attachment_update completed successfully. Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Flow 'volume_create_manager' (6126e7a5-efa1-4339-bfad-8051829a1e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5117a0-1f7a-4a12-8a9d-50cccc1e87d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5117a0-1f7a-4a12-8a9d-50cccc1e87d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-84387936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0752d32-4a9b-4805-b00a-b70653437f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e946c421f46145b48117a70631292124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:41:09Z,use_quota=True,user_id='c91ef5e446344751bfdc089a3892177f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ccaf08-0adc-4516-81c4-7d3c74d60161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ccaf08-0adc-4516-81c4-7d3c74d60161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28223af9-4ace-4830-9c32-a821ad94b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28223af9-4ace-4830-9c32-a821ad94b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0752d32-4a9b-4805-b00a-b70653437f3e', 'volume_name': 'volume-d0752d32-4a9b-4805-b00a-b70653437f3e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5963d3-387d-40ca-a2ed-5d149379bf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5963d3-387d-40ca-a2ed-5d149379bf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c87d02-b2ae-4f22-8d11-9c9d3004357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:09 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Volume d0752d32-4a9b-4805-b00a-b70653437f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0752d32-4a9b-4805-b00a-b70653437f3e', 'volume_size': 1} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-84387936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0752d32-4a9b-4805-b00a-b70653437f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e946c421f46145b48117a70631292124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:41:09Z,use_quota=True,user_id='c91ef5e446344751bfdc089a3892177f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Creating volume d0752d32-4a9b-4805-b00a-b70653437f3e {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:41:09 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:41:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:09 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e 1073741824 Sep 09 03:41:09 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:10 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e 1073741824" returned: 0 in 1.099s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:10 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e Sep 09 03:41:10 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:10 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e" returned: 0 in 0.496s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:41:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c87d02-b2ae-4f22-8d11-9c9d3004357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0752d32-4a9b-4805-b00a-b70653437f3e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb826056-ef6b-4af4-a54f-135bdb8247ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Volume volume-d0752d32-4a9b-4805-b00a-b70653437f3e (d0752d32-4a9b-4805-b00a-b70653437f3e): created successfully Sep 09 03:41:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb826056-ef6b-4af4-a54f-135bdb8247ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Flow 'volume_create_manager' (6126e7a5-efa1-4339-bfad-8051829a1e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:41:11 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0a8bbe01-a801-4b30-a28f-a66704f6f3be tempest-ServerActionsTestOtherA-1735223895 None] Created volume successfully. Sep 09 03:41:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-ccae35a6-b288-4f80-8bad-c9de4c042364 req-2504260d-90e6-4aa0-95a1-273e4df3a025 tempest-DeleteServersTestJSON-1273933714 None] Terminate volume connection completed successfully. Sep 09 03:41:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-ccae35a6-b288-4f80-8bad-c9de4c042364 req-2504260d-90e6-4aa0-95a1-273e4df3a025 tempest-DeleteServersTestJSON-1273933714 None] Deleting attachment 29e3836a-8ae4-406b-9219-71c1c7d6eb22. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:41:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Acquiring lock "cinder-ecb964ae-ae1b-4ca4-9452-59e0915eed14-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:41:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Lock "cinder-ecb964ae-ae1b-4ca4-9452-59e0915eed14-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:41:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Acquiring lock "cinder-quobyte-ecb964ae-ae1b-4ca4-9452-59e0915eed14" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:41:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Lock "cinder-quobyte-ecb964ae-ae1b-4ca4-9452-59e0915eed14" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:41:17 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d216da6b-d4aa-4455-9af4-91c3e8089a90]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:41:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:17 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 Sep 09 03:41:17 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:18 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14" returned: 0 in 0.702s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:18 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14 Sep 09 03:41:18 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:18 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ecb964ae-ae1b-4ca4-9452-59e0915eed14" returned: 0 in 0.532s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Lock "cinder-quobyte-ecb964ae-ae1b-4ca4-9452-59e0915eed14" released by "delete_volume" :: held 1.309s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Created reservations ['b9c9cfef-82a0-49f8-8eab-2df3c4213cb3', 'b7a98f17-5e86-47bc-9131-01079029c6a8', 'f9ec559c-0796-4717-af04-86bb316a7955', '4eff61c1-2a30-435d-b5a5-08519ef1bedf'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:18 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:41:19 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:19 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.460s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:19 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:41:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Deleted volume successfully. Sep 09 03:41:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbc68830-8590-450d-bc42-91feeddc8398 tempest-DeleteServersTestJSON-1273933714 None] Lock "cinder-ecb964ae-ae1b-4ca4-9452-59e0915eed14-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:41:28 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=14,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:41:29 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=3 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:37 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:41:37 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:37 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.336s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Flow 'volume_create_manager' (f1b743b5-42e6-4ad7-9cb3-ef29c40cb805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466c44a1-ff11-4312-bbdd-232a2fac1185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466c44a1-ff11-4312-bbdd-232a2fac1185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-87358754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f556ec8-8362-44c4-a494-6b46fb22a2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a06f79f4ba47e4a84bc6b77b477eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:41:42Z,use_quota=True,user_id='daab43ee3be34bcf9d4706b6fa8e12e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e498dfe8-8339-4eee-8538-f8adbc0b06e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e498dfe8-8339-4eee-8538-f8adbc0b06e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b85bee-fed1-42d1-838a-ddb20b684b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b85bee-fed1-42d1-838a-ddb20b684b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f556ec8-8362-44c4-a494-6b46fb22a2cb', 'volume_name': 'volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605db5cd-401c-4315-87a5-c168dd56d191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605db5cd-401c-4315-87a5-c168dd56d191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15122d7-ad78-4fbc-98bd-b6e8893b30dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:42 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Volume 7f556ec8-8362-44c4-a494-6b46fb22a2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb', 'volume_size': 1} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-87358754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f556ec8-8362-44c4-a494-6b46fb22a2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a06f79f4ba47e4a84bc6b77b477eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:41:42Z,use_quota=True,user_id='daab43ee3be34bcf9d4706b6fa8e12e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Creating volume 7f556ec8-8362-44c4-a494-6b46fb22a2cb {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:41:42 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:41:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:42 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb 1073741824 Sep 09 03:41:42 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:43 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb 1073741824" returned: 0 in 0.554s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:43 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb Sep 09 03:41:43 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:43 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb" returned: 0 in 0.316s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15122d7-ad78-4fbc-98bd-b6e8893b30dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa09a44-f2fd-445a-96c0-489d1be5a928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:43 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Volume volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb (7f556ec8-8362-44c4-a494-6b46fb22a2cb): created successfully Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa09a44-f2fd-445a-96c0-489d1be5a928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Flow 'volume_create_manager' (f1b743b5-42e6-4ad7-9cb3-ef29c40cb805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:41:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-598f97e0-5ebc-4c49-8163-d38e3398a6d6 tempest-AttachVolumeNegativeTest-1071945405 None] Created volume successfully. Sep 09 03:41:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-2787792a-a60e-426b-a723-328479bf5781 req-19e2a3bc-27dd-49a1-aba0-5be794993681 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-2787792a-a60e-426b-a723-328479bf5781 req-19e2a3bc-27dd-49a1-aba0-5be794993681 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-2787792a-a60e-426b-a723-328479bf5781 req-19e2a3bc-27dd-49a1-aba0-5be794993681 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-2787792a-a60e-426b-a723-328479bf5781 req-19e2a3bc-27dd-49a1-aba0-5be794993681 tempest-AttachVolumeNegativeTest-1071945405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cacdedb-0896-46c0-9420-976449f976e6', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:41:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-2787792a-a60e-426b-a723-328479bf5781 req-19e2a3bc-27dd-49a1-aba0-5be794993681 tempest-AttachVolumeNegativeTest-1071945405 None] attachment_update completed successfully. Sep 09 03:41:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-bdeff8fc-b23a-4189-a310-14e0d1098020 req-13342cb7-fe82-4eca-b35b-5e639b59d468 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-bdeff8fc-b23a-4189-a310-14e0d1098020 req-13342cb7-fe82-4eca-b35b-5e639b59d468 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-bdeff8fc-b23a-4189-a310-14e0d1098020 req-13342cb7-fe82-4eca-b35b-5e639b59d468 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-bdeff8fc-b23a-4189-a310-14e0d1098020 req-13342cb7-fe82-4eca-b35b-5e639b59d468 tempest-ServerActionsTestOtherA-1735223895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-d0752d32-4a9b-4805-b00a-b70653437f3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1049deb0-7fb1-4a1d-8afa-21e92006833a', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:41:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-bdeff8fc-b23a-4189-a310-14e0d1098020 req-13342cb7-fe82-4eca-b35b-5e639b59d468 tempest-ServerActionsTestOtherA-1735223895 None] attachment_update completed successfully. Sep 09 03:41:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-567db2c8-f844-4be2-ba76-edf6b0aae350 req-faec05f3-79d3-454c-8ee4-71eaaed37e5c tempest-ServerActionsTestOtherA-1735223895 None] Terminate volume connection completed successfully. Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-567db2c8-f844-4be2-ba76-edf6b0aae350 req-faec05f3-79d3-454c-8ee4-71eaaed37e5c tempest-ServerActionsTestOtherA-1735223895 None] Deleting attachment 1049deb0-7fb1-4a1d-8afa-21e92006833a. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Flow 'volume_create_manager' (ca08b6b5-6832-4b2c-97c8-5adc253eb783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b721ba-88ee-483d-9db5-e0f90475d3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b721ba-88ee-483d-9db5-e0f90475d3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-878912819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6812458-c0dc-4810-9505-0583a55ce620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c065033dfef4744b7a2a1ac82aa1b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:41:57Z,use_quota=True,user_id='22f9233a8784453bbc878b8a065e8422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730dd206-fe95-415f-b6ac-51ed78edaa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730dd206-fe95-415f-b6ac-51ed78edaa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94fd5ee-e18f-43b3-9f74-5db250a6f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94fd5ee-e18f-43b3-9f74-5db250a6f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6812458-c0dc-4810-9505-0583a55ce620', 'volume_name': 'volume-d6812458-c0dc-4810-9505-0583a55ce620', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f19d3c-44af-41e4-8ed1-4d301f5ca975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f19d3c-44af-41e4-8ed1-4d301f5ca975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83462a16-a886-4a6e-9b44-ef47eb762308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:57 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Volume d6812458-c0dc-4810-9505-0583a55ce620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6812458-c0dc-4810-9505-0583a55ce620', 'volume_size': 1} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-878912819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6812458-c0dc-4810-9505-0583a55ce620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c065033dfef4744b7a2a1ac82aa1b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:41:57Z,use_quota=True,user_id='22f9233a8784453bbc878b8a065e8422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Creating volume d6812458-c0dc-4810-9505-0583a55ce620 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:41:57 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:41:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:57 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 1073741824 Sep 09 03:41:57 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:58 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 1073741824" returned: 0 in 0.968s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-567db2c8-f844-4be2-ba76-edf6b0aae350 req-f081cfdf-9394-4991-b50b-cde7b47511c9 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:41:58 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 Sep 09 03:41:58 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:41:58 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620" returned: 0 in 0.384s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-567db2c8-f844-4be2-ba76-edf6b0aae350 req-f081cfdf-9394-4991-b50b-cde7b47511c9 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.426s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83462a16-a886-4a6e-9b44-ef47eb762308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6812458-c0dc-4810-9505-0583a55ce620', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237af569-b302-4d52-a56a-b00bb15a61f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-567db2c8-f844-4be2-ba76-edf6b0aae350 req-f081cfdf-9394-4991-b50b-cde7b47511c9 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:41:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Volume volume-d6812458-c0dc-4810-9505-0583a55ce620 (d6812458-c0dc-4810-9505-0583a55ce620): created successfully Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237af569-b302-4d52-a56a-b00bb15a61f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Flow 'volume_create_manager' (ca08b6b5-6832-4b2c-97c8-5adc253eb783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:41:58 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-04b3f04c-2934-4251-903a-5e00821188b2 tempest-TaggedAttachmentsTest-597169175 None] Created volume successfully. Sep 09 03:41:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-567db2c8-f844-4be2-ba76-edf6b0aae350 req-f081cfdf-9394-4991-b50b-cde7b47511c9 tempest-ServerActionsTestOtherA-1735223895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-d0752d32-4a9b-4805-b00a-b70653437f3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eea0fa17-8731-41c5-9f77-6126a86754f4', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:41:58 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-567db2c8-f844-4be2-ba76-edf6b0aae350 req-f081cfdf-9394-4991-b50b-cde7b47511c9 tempest-ServerActionsTestOtherA-1735223895 None] attachment_update completed successfully. Sep 09 03:42:08 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=21,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:42:08 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=13,cinder:SELECT=28,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:42:29 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-33ac55a0-4c6c-4ed3-8ee0-74f59c9840d3 req-af6644c9-4bb2-4c32-8488-4fbb6e8525b8 tempest-ServerActionsTestOtherA-1735223895 None] Terminate volume connection completed successfully. Sep 09 03:42:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-33ac55a0-4c6c-4ed3-8ee0-74f59c9840d3 req-af6644c9-4bb2-4c32-8488-4fbb6e8525b8 tempest-ServerActionsTestOtherA-1735223895 None] Deleting attachment eea0fa17-8731-41c5-9f77-6126a86754f4. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:42:35 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Flow 'volume_create_manager' (b0893dd5-f7d7-4b98-a92d-5e02cae5bbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b937d1fa-320d-47f1-ac11-8e84481e8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b937d1fa-320d-47f1-ac11-8e84481e8930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1984872144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1bdca6-1e16-4691-b845-3637fb2aa24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073e324a0a7c4584b9e91a93b0ecd3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:42:36Z,use_quota=True,user_id='a42a47e5d9e04ce58e3b00838b4f1095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d39a32f-0523-4c9f-b92d-295109f470ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d39a32f-0523-4c9f-b92d-295109f470ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec412ac-b0a9-4cef-9e49-45a309464c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec412ac-b0a9-4cef-9e49-45a309464c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1bdca6-1e16-4691-b845-3637fb2aa24c', 'volume_name': 'volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6498397d-d8f9-4483-95ee-76be9f49dad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6498397d-d8f9-4483-95ee-76be9f49dad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9a7d54-9ec5-4981-8284-ccda4d4fd116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:36 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Volume ac1bdca6-1e16-4691-b845-3637fb2aa24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c', 'volume_size': 1} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1984872144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1bdca6-1e16-4691-b845-3637fb2aa24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073e324a0a7c4584b9e91a93b0ecd3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:42:36Z,use_quota=True,user_id='a42a47e5d9e04ce58e3b00838b4f1095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Creating volume ac1bdca6-1e16-4691-b845-3637fb2aa24c {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:42:36 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:36 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c 1073741824 Sep 09 03:42:36 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:36 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c 1073741824" returned: 0 in 0.688s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:36 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c Sep 09 03:42:36 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:37 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c" returned: 0 in 0.301s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9a7d54-9ec5-4981-8284-ccda4d4fd116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f3e885-3e60-4645-a760-2c78513ce55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Volume volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c (ac1bdca6-1e16-4691-b845-3637fb2aa24c): created successfully Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f3e885-3e60-4645-a760-2c78513ce55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Flow 'volume_create_manager' (b0893dd5-f7d7-4b98-a92d-5e02cae5bbe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:42:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-da606489-ec1f-4ea3-8962-d11796e8a8ce tempest-AttachVolumeTestJSON-1802340450 None] Created volume successfully. Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:37 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:42:37 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Flow 'volume_create_manager' (c15ce6a6-c363-45f3-ab8f-07e6b73c446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd2efaf-f1de-4553-bcf4-eefffca1e967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:37 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.394s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd2efaf-f1de-4553-bcf4-eefffca1e967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-860494409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfcfdc4-6b83-4171-b65a-169e87db6c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e946c421f46145b48117a70631292124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:42:38Z,use_quota=True,user_id='c91ef5e446344751bfdc089a3892177f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac07b16-2d8e-4f2a-af62-d3e1ad02150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac07b16-2d8e-4f2a-af62-d3e1ad02150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f489e272-8c5f-44f3-b283-d996d09c3dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 8 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:42:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:42:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f489e272-8c5f-44f3-b283-d996d09c3dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0dfcfdc4-6b83-4171-b65a-169e87db6c1d', 'volume_name': 'volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a534ea6d-971b-448c-81a6-dddd6686f781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a534ea6d-971b-448c-81a6-dddd6686f781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89631e22-6bf5-4dab-aadb-11e1aa45c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Volume 0dfcfdc4-6b83-4171-b65a-169e87db6c1d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 03:42:38 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Trying to clone 0dfcfdc4-6b83-4171-b65a-169e87db6c1d from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f at location (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:42:38 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:42:38 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Image download 20.69 MB at 20.69 MB/s Sep 09 03:42:38 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa8229b-d3be-4fca-9688-64ddae281b2b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:42:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:38 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD Sep 09 03:42:38 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:39 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:39 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f is fetched for user c91ef5e446344751bfdc089a3892177f. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:42:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-23487b22-e204-4f53-86aa-2e17fb9d2882 req-9de55503-1201-4627-92a1-bebb40107e5a tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-23487b22-e204-4f53-86aa-2e17fb9d2882 req-9de55503-1201-4627-92a1-bebb40107e5a tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-23487b22-e204-4f53-86aa-2e17fb9d2882 req-9de55503-1201-4627-92a1-bebb40107e5a tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-23487b22-e204-4f53-86aa-2e17fb9d2882 req-9de55503-1201-4627-92a1-bebb40107e5a tempest-AttachVolumeTestJSON-1802340450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d69649e-2416-4c95-a0fc-5897668435dc', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abd25a3-75f8-475e-a782-3423aadce257]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:42 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD Sep 09 03:42:42 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:42 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-860494409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfcfdc4-6b83-4171-b65a-169e87db6c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e946c421f46145b48117a70631292124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:42:38Z,use_quota=True,user_id='c91ef5e446344751bfdc089a3892177f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Creating volume 0dfcfdc4-6b83-4171-b65a-169e87db6c1d {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:42:42 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:42 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d 1073741824 Sep 09 03:42:42 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:42 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d 1073741824" returned: 0 in 0.378s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:44 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-23487b22-e204-4f53-86aa-2e17fb9d2882 req-9de55503-1201-4627-92a1-bebb40107e5a tempest-AttachVolumeTestJSON-1802340450 None] attachment_update completed successfully. Sep 09 03:42:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:44 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d Sep 09 03:42:44 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:45 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d" returned: 0 in 0.470s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] <== create_volume: return (2726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:42:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.735s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:45 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Attempting download of 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume 0dfcfdc4-6b83-4171-b65a-169e87db6c1d. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:42:45 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d41f33-58bd-4c69-ab1f-b6ee39454744]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:42:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_f6wxs_w3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:45 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_f6wxs_w3 Sep 09 03:42:45 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:45 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_f6wxs_w3" returned: 0 in 0.511s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_f6wxs_w3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:46 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_f6wxs_w3 Sep 09 03:42:46 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:46 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_f6wxs_w3" returned: 1 in 0.430s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_f6wxs_w3' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:42:46 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e6cade-b6d3-4f5b-b555-fad35db368fc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:42:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:46 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD Sep 09 03:42:46 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:46 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:46 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f was qcow2, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:42:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-2114f7ee-2843-4edb-8bff-79c4fe67dde4 req-3b0766a2-3d79-48a7-a6d3-1eb5c68d7254 tempest-AttachVolumeNegativeTest-1071945405 None] Terminate volume connection completed successfully. Sep 09 03:42:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-2114f7ee-2843-4edb-8bff-79c4fe67dde4 req-3b0766a2-3d79-48a7-a6d3-1eb5c68d7254 tempest-AttachVolumeNegativeTest-1071945405 None] Deleting attachment 2cacdedb-0896-46c0-9420-976449f976e6. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:42:46 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d Sep 09 03:42:46 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Flow 'volume_create_manager' (8b91ee52-a0a4-4003-a5a5-e49214b5a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5151292-31c0-4825-95c8-b9d222c76192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5151292-31c0-4825-95c8-b9d222c76192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2012919929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8eb2fca-435b-4388-8326-15ff558f5010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073e324a0a7c4584b9e91a93b0ecd3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:42:47Z,use_quota=True,user_id='a42a47e5d9e04ce58e3b00838b4f1095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17655600-a51b-4aec-b5f4-197d320608b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17655600-a51b-4aec-b5f4-197d320608b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4741e169-3185-4021-8182-cb62f3aff94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4741e169-3185-4021-8182-cb62f3aff94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8eb2fca-435b-4388-8326-15ff558f5010', 'volume_name': 'volume-a8eb2fca-435b-4388-8326-15ff558f5010', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d510615f-02c6-45b7-86f1-2c48d9f68eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d510615f-02c6-45b7-86f1-2c48d9f68eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef96339b-934b-4cc3-89b0-6a2b14eddd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Volume a8eb2fca-435b-4388-8326-15ff558f5010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8eb2fca-435b-4388-8326-15ff558f5010', 'volume_size': 1} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2012919929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8eb2fca-435b-4388-8326-15ff558f5010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073e324a0a7c4584b9e91a93b0ecd3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:42:47Z,use_quota=True,user_id='a42a47e5d9e04ce58e3b00838b4f1095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Creating volume a8eb2fca-435b-4388-8326-15ff558f5010 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:42:47 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:42:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:47 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 1073741824 Sep 09 03:42:47 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:48 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 1073741824" returned: 0 in 0.653s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:48 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 Sep 09 03:42:48 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:48 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010" returned: 0 in 0.563s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef96339b-934b-4cc3-89b0-6a2b14eddd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8eb2fca-435b-4388-8326-15ff558f5010', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e13ac2a-19c1-46d3-97b5-7976de286a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:48 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Volume volume-a8eb2fca-435b-4388-8326-15ff558f5010 (a8eb2fca-435b-4388-8326-15ff558f5010): created successfully Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e13ac2a-19c1-46d3-97b5-7976de286a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Flow 'volume_create_manager' (8b91ee52-a0a4-4003-a5a5-e49214b5a940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:42:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-461300b9-8387-490e-81b9-510fc95d9593 tempest-AttachVolumeTestJSON-1802340450 None] Created volume successfully. Sep 09 03:42:49 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d" returned: 0 in 2.435s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_xwj0eg25devstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:42:49 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Converted 112.00 MB image at 45.97 MB/s Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:42:49 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d 1G Sep 09 03:42:49 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:42:49 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d 1G" returned: 0 in 0.403s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Downloaded image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume 0dfcfdc4-6b83-4171-b65a-169e87db6c1d successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f for user c91ef5e446344751bfdc089a3892177f is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Marking volume 0dfcfdc4-6b83-4171-b65a-169e87db6c1d as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Copying metadata from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f to 0dfcfdc4-6b83-4171-b65a-169e87db6c1d. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Creating volume glance metadata for volume 0dfcfdc4-6b83-4171-b65a-169e87db6c1d backed by image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89631e22-6bf5-4dab-aadb-11e1aa45c13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ca3a6f-f7a8-4c35-8f5c-8504c2f55b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:42:49 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Volume volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d (0dfcfdc4-6b83-4171-b65a-169e87db6c1d): created successfully Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ca3a6f-f7a8-4c35-8f5c-8504c2f55b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:42:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Flow 'volume_create_manager' (c15ce6a6-c363-45f3-ab8f-07e6b73c446f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:42:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1907888c-1db0-4000-8783-cf6a36083239 tempest-ServerActionsTestOtherA-1735223895 None] Created volume successfully. Sep 09 03:42:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-48e7d5c4-b807-4332-b6de-78576e562f55 req-32f4c684-27c7-4572-badd-8a2a4e5105f9 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-48e7d5c4-b807-4332-b6de-78576e562f55 req-32f4c684-27c7-4572-badd-8a2a4e5105f9 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-48e7d5c4-b807-4332-b6de-78576e562f55 req-32f4c684-27c7-4572-badd-8a2a4e5105f9 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-48e7d5c4-b807-4332-b6de-78576e562f55 req-32f4c684-27c7-4572-badd-8a2a4e5105f9 tempest-AttachVolumeTestJSON-1802340450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-a8eb2fca-435b-4388-8326-15ff558f5010', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf4ba611-5363-40e5-9773-f789452eb672', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:42:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-48e7d5c4-b807-4332-b6de-78576e562f55 req-32f4c684-27c7-4572-badd-8a2a4e5105f9 tempest-AttachVolumeTestJSON-1802340450 None] attachment_update completed successfully. Sep 09 03:42:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-851398dc-c4e3-4816-a707-9bcd6118439a req-a6a19e8c-1efc-404c-b76b-fc9e4fdaa23d tempest-TaggedAttachmentsTest-597169175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-851398dc-c4e3-4816-a707-9bcd6118439a req-a6a19e8c-1efc-404c-b76b-fc9e4fdaa23d tempest-TaggedAttachmentsTest-597169175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-851398dc-c4e3-4816-a707-9bcd6118439a req-a6a19e8c-1efc-404c-b76b-fc9e4fdaa23d tempest-TaggedAttachmentsTest-597169175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-851398dc-c4e3-4816-a707-9bcd6118439a req-a6a19e8c-1efc-404c-b76b-fc9e4fdaa23d tempest-TaggedAttachmentsTest-597169175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-d6812458-c0dc-4810-9505-0583a55ce620', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcc11a49-dbb9-4f1b-81d0-f36b0d329d88', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:42:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-851398dc-c4e3-4816-a707-9bcd6118439a req-a6a19e8c-1efc-404c-b76b-fc9e4fdaa23d tempest-TaggedAttachmentsTest-597169175 None] attachment_update completed successfully. Sep 09 03:42:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-dce465bc-6b26-4faf-b28b-1ee13fbd6e2e req-348cc6f5-b4a5-49f1-bbd1-531113294cc5 tempest-AttachVolumeTestJSON-1802340450 None] Terminate volume connection completed successfully. Sep 09 03:42:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-dce465bc-6b26-4faf-b28b-1ee13fbd6e2e req-348cc6f5-b4a5-49f1-bbd1-531113294cc5 tempest-AttachVolumeTestJSON-1802340450 None] Deleting attachment 2d69649e-2416-4c95-a0fc-5897668435dc. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:42:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-98fa15ac-7424-41f1-bf04-dc8a371161eb req-a27211ac-a23b-495a-a312-061d78a82dd7 tempest-TaggedAttachmentsTest-597169175 None] Terminate volume connection completed successfully. Sep 09 03:42:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-98fa15ac-7424-41f1-bf04-dc8a371161eb req-a27211ac-a23b-495a-a312-061d78a82dd7 tempest-TaggedAttachmentsTest-597169175 None] Deleting attachment fcc11a49-dbb9-4f1b-81d0-f36b0d329d88. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:42:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-d78a1d6d-1a39-4e03-ab90-2c7a2d5996d4 req-fafab1fa-f12d-4079-84fe-350e87b94310 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:42:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-d78a1d6d-1a39-4e03-ab90-2c7a2d5996d4 req-fafab1fa-f12d-4079-84fe-350e87b94310 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:42:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-d78a1d6d-1a39-4e03-ab90-2c7a2d5996d4 req-fafab1fa-f12d-4079-84fe-350e87b94310 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:42:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-d78a1d6d-1a39-4e03-ab90-2c7a2d5996d4 req-fafab1fa-f12d-4079-84fe-350e87b94310 tempest-ServerActionsTestOtherA-1735223895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d400217-8a5b-4b66-aca4-6f9ebcdb92de', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:42:55 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-d78a1d6d-1a39-4e03-ab90-2c7a2d5996d4 req-fafab1fa-f12d-4079-84fe-350e87b94310 tempest-ServerActionsTestOtherA-1735223895 None] attachment_update completed successfully. Sep 09 03:42:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-1fc172b4-d56b-4a15-bbce-70d530ed9169 req-aded534b-8aff-437c-8857-f1dda01b3167 tempest-AttachVolumeTestJSON-1802340450 None] Terminate volume connection completed successfully. Sep 09 03:42:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-1fc172b4-d56b-4a15-bbce-70d530ed9169 req-aded534b-8aff-437c-8857-f1dda01b3167 tempest-AttachVolumeTestJSON-1802340450 None] Deleting attachment cf4ba611-5363-40e5-9773-f789452eb672. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:43:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "cinder-a8eb2fca-435b-4388-8326-15ff558f5010-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-a8eb2fca-435b-4388-8326-15ff558f5010-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "cinder-quobyte-a8eb2fca-435b-4388-8326-15ff558f5010" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-quobyte-a8eb2fca-435b-4388-8326-15ff558f5010" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc54c4-799a-4675-83b6-38082866e402]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:05 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 Sep 09 03:43:05 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:06 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010" returned: 0 in 0.784s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:06 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010 Sep 09 03:43:06 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:06 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a8eb2fca-435b-4388-8326-15ff558f5010" returned: 0 in 0.428s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-quobyte-a8eb2fca-435b-4388-8326-15ff558f5010" released by "delete_volume" :: held 1.315s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Created reservations ['85810ca7-d490-4136-9cf2-442bafb8c1f2', '45100dbe-8db6-496a-9d0d-41d16f089c6a', 'ef6d40ac-f53e-4d29-8241-a7307882410e', 'c2f7bf46-5989-4a35-b9e4-561512b3134a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:07 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:43:07 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:07 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.390s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:43:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Deleted volume successfully. Sep 09 03:43:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aaedc75f-a361-4027-959c-5e1dadb5f814 tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-a8eb2fca-435b-4388-8326-15ff558f5010-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "cinder-ac1bdca6-1e16-4691-b845-3637fb2aa24c-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-ac1bdca6-1e16-4691-b845-3637fb2aa24c-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "cinder-quobyte-ac1bdca6-1e16-4691-b845-3637fb2aa24c" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-quobyte-ac1bdca6-1e16-4691-b845-3637fb2aa24c" acquired by "delete_volume" :: waited 0.048s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e48260b-b9f9-4234-ad2c-450ce4e58195]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:08 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c Sep 09 03:43:08 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:09 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c" returned: 0 in 1.119s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:09 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c Sep 09 03:43:09 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:10 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ac1bdca6-1e16-4691-b845-3637fb2aa24c" returned: 0 in 0.517s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-quobyte-ac1bdca6-1e16-4691-b845-3637fb2aa24c" released by "delete_volume" :: held 1.737s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Created reservations ['5bcff06e-6d88-484c-bd82-74e0c48077d4', '0b5a656f-6188-4efe-98af-d06470b6097e', '0c71533d-c8de-4953-bedf-e2fb2425e775', '977e42d3-0229-4ee3-bfdc-9d2623e20d63'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:10 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:43:10 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:10 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.438s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:43:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Deleted volume successfully. Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87ecb1e3-6e6c-4605-b2b2-17bb01bd899d tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-ac1bdca6-1e16-4691-b845-3637fb2aa24c-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "cinder-36520b7f-18d8-4785-932f-365d1e26ef96-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-36520b7f-18d8-4785-932f-365d1e26ef96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "cinder-quobyte-36520b7f-18d8-4785-932f-365d1e26ef96" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-quobyte-36520b7f-18d8-4785-932f-365d1e26ef96" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:11 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbb08fc-ca97-4097-b0cf-08df1d033a56]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:11 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 Sep 09 03:43:11 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:11 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96" returned: 0 in 0.571s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:11 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96 Sep 09 03:43:11 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:12 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-36520b7f-18d8-4785-932f-365d1e26ef96" returned: 0 in 0.588s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-quobyte-36520b7f-18d8-4785-932f-365d1e26ef96" released by "delete_volume" :: held 1.220s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Created reservations ['d367569d-38c5-48e9-8da4-e14bdb268e7a', '81dd8138-1cc2-43ad-869d-6e03dbd63e34', 'd044861d-a470-49a7-8bee-bf0a0781eb23', '53ed6915-afcb-4833-bbf4-d34e09ad2b74'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Acquiring lock "cinder-d6812458-c0dc-4810-9505-0583a55ce620-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Lock "cinder-d6812458-c0dc-4810-9505-0583a55ce620-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:12 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:43:12 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Acquiring lock "cinder-quobyte-d6812458-c0dc-4810-9505-0583a55ce620" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Lock "cinder-quobyte-d6812458-c0dc-4810-9505-0583a55ce620" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d3ee3c-7ed3-4178-84bc-f7d9865b7258]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:13 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.565s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:13 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:43:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Deleted volume successfully. Sep 09 03:43:13 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 Sep 09 03:43:13 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4f52f2-f246-4239-b6f1-4dbdb89c0709 tempest-AttachVolumeTestJSON-1802340450 None] Lock "cinder-36520b7f-18d8-4785-932f-365d1e26ef96-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:13 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620" returned: 0 in 1.127s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:13 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620 Sep 09 03:43:13 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:14 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6812458-c0dc-4810-9505-0583a55ce620" returned: 0 in 0.520s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Lock "cinder-quobyte-d6812458-c0dc-4810-9505-0583a55ce620" released by "delete_volume" :: held 1.753s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Created reservations ['1b83d540-13df-4503-9e75-9f58d0c8b767', '31228f77-7e48-46d2-b2fe-3322f6c83b9f', 'b3e9f743-a532-4038-b43c-b862ed1681fa', '3993d333-bfee-4dee-9a42-5f4be30b6eb4'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:14 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:43:14 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:15 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.656s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:15 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:43:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Deleted volume successfully. Sep 09 03:43:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-45281050-39b1-419b-8288-29cb10a2561b tempest-TaggedAttachmentsTest-597169175 None] Lock "cinder-d6812458-c0dc-4810-9505-0583a55ce620-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:24 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=68,cinder:UPDATE=46,cinder:INSERT=15,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:43:25 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-cf265f33-ba41-4844-9edf-3cb20896477d req-e84efc86-e8f9-42fe-a5a0-005f34fd3a9e tempest-ServerActionsTestOtherA-1735223895 None] Terminate volume connection completed successfully. Sep 09 03:43:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-cf265f33-ba41-4844-9edf-3cb20896477d req-e84efc86-e8f9-42fe-a5a0-005f34fd3a9e tempest-ServerActionsTestOtherA-1735223895 None] Deleting attachment 6d400217-8a5b-4b66-aca4-6f9ebcdb92de. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:43:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-cf265f33-ba41-4844-9edf-3cb20896477d req-f455364d-6aa8-4291-af08-3c2501cf4af4 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-cf265f33-ba41-4844-9edf-3cb20896477d req-f455364d-6aa8-4291-af08-3c2501cf4af4 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-cf265f33-ba41-4844-9edf-3cb20896477d req-f455364d-6aa8-4291-af08-3c2501cf4af4 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-cf265f33-ba41-4844-9edf-3cb20896477d req-f455364d-6aa8-4291-af08-3c2501cf4af4 tempest-ServerActionsTestOtherA-1735223895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79d225ac-6352-44bd-9ca4-832f11add229', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:43:27 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-cf265f33-ba41-4844-9edf-3cb20896477d req-f455364d-6aa8-4291-af08-3c2501cf4af4 tempest-ServerActionsTestOtherA-1735223895 None] attachment_update completed successfully. Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=70,cinder:UPDATE=53,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Flow 'volume_create_manager' (9f5291fe-b2ed-4448-9022-97f526c6767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1f7395-fff1-4311-8e09-4bf9c517fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1f7395-fff1-4311-8e09-4bf9c517fc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-816900171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f78f872-f6cf-4741-a617-28c212d9f394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a06f79f4ba47e4a84bc6b77b477eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:43:36Z,use_quota=True,user_id='daab43ee3be34bcf9d4706b6fa8e12e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7877346b-5890-490f-b78f-e63df9a52d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7877346b-5890-490f-b78f-e63df9a52d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791236b9-277a-49a3-abba-0e93361e1d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791236b9-277a-49a3-abba-0e93361e1d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f78f872-f6cf-4741-a617-28c212d9f394', 'volume_name': 'volume-7f78f872-f6cf-4741-a617-28c212d9f394', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192b154a-995c-4292-808d-6cc7c4789729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192b154a-995c-4292-808d-6cc7c4789729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559c91a5-cc92-47c0-ae34-49cb05795a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:36 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Volume 7f78f872-f6cf-4741-a617-28c212d9f394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f78f872-f6cf-4741-a617-28c212d9f394', 'volume_size': 1} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-816900171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f78f872-f6cf-4741-a617-28c212d9f394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a06f79f4ba47e4a84bc6b77b477eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:43:36Z,use_quota=True,user_id='daab43ee3be34bcf9d4706b6fa8e12e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Creating volume 7f78f872-f6cf-4741-a617-28c212d9f394 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:43:36 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:43:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:36 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 1073741824 Sep 09 03:43:36 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:37 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:43:37 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:37 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 1073741824" returned: 0 in 0.785s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:37 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 Sep 09 03:43:37 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:37 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.407s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:43:37 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394" returned: 0 in 0.408s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559c91a5-cc92-47c0-ae34-49cb05795a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f78f872-f6cf-4741-a617-28c212d9f394', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6650cd12-d3fb-458d-ac4c-871a9dab91ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Volume volume-7f78f872-f6cf-4741-a617-28c212d9f394 (7f78f872-f6cf-4741-a617-28c212d9f394): created successfully Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6650cd12-d3fb-458d-ac4c-871a9dab91ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Flow 'volume_create_manager' (9f5291fe-b2ed-4448-9022-97f526c6767f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:43:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4d2feefd-8ec4-4dac-acbe-866da61f58b5 tempest-AttachVolumeNegativeTest-1071945405 None] Created volume successfully. Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Flow 'volume_create_manager' (122367cb-5a77-4bae-a7c1-834a9e830c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4323545a-6b29-4f07-a93d-36c458812e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4323545a-6b29-4f07-a93d-36c458812e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1934819356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a95870098fb465caff7b1f6b3df2944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:43:38Z,use_quota=True,user_id='bdb5eea1d4f04260bce84244b1a109ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8986c061-fce0-41da-b183-39e9d9223145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8986c061-fce0-41da-b183-39e9d9223145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021a0f26-bc36-4f60-9850-3a993683a191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021a0f26-bc36-4f60-9850-3a993683a191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490', 'volume_name': 'volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e58b61-e413-4896-940b-c7a168c8c18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e58b61-e413-4896-940b-c7a168c8c18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7723db99-18f7-48ce-85c0-60b8090946ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490', 'volume_size': 1} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1934819356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a95870098fb465caff7b1f6b3df2944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:43:38Z,use_quota=True,user_id='bdb5eea1d4f04260bce84244b1a109ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Creating volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:43:38 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:43:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:38 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 1073741824 Sep 09 03:43:38 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:39 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 1073741824" returned: 0 in 0.626s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:39 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 Sep 09 03:43:39 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:39 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" returned: 0 in 0.340s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7723db99-18f7-48ce-85c0-60b8090946ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8dfc54-f30d-47c2-82a1-ba4cf48eae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:43:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Volume volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 (a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490): created successfully Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8dfc54-f30d-47c2-82a1-ba4cf48eae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Flow 'volume_create_manager' (122367cb-5a77-4bae-a7c1-834a9e830c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:43:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6d0b6eab-612b-45d4-9d3a-a23f48951074 tempest-SnapshotsActionsTest-844924787 None] Created volume successfully. Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-c3325df6-a3f0-4b53-b130-295b291b8645 req-03f32da1-4bcb-4ea6-8e7c-b182f105fe8f tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-c3325df6-a3f0-4b53-b130-295b291b8645 req-03f32da1-4bcb-4ea6-8e7c-b182f105fe8f tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-c3325df6-a3f0-4b53-b130-295b291b8645 req-03f32da1-4bcb-4ea6-8e7c-b182f105fe8f tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-c3325df6-a3f0-4b53-b130-295b291b8645 req-03f32da1-4bcb-4ea6-8e7c-b182f105fe8f tempest-AttachVolumeNegativeTest-1071945405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-7f78f872-f6cf-4741-a617-28c212d9f394', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd03f998c-9052-4147-8de6-cc5e4efe8117', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:43:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-c3325df6-a3f0-4b53-b130-295b291b8645 req-03f32da1-4bcb-4ea6-8e7c-b182f105fe8f tempest-AttachVolumeNegativeTest-1071945405 None] attachment_update completed successfully. Sep 09 03:43:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Creating offline snapshot 0af23b4f-9858-45f9-a779-6aac537f3826 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:43:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ee174-aeb1-4b19-932c-b8a07bbb7793]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:41 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 Sep 09 03:43:41 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:41 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" returned: 0 in 0.688s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:41 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 1G Sep 09 03:43:41 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-97bad10a-7e2c-4c28-b2c4-2a7dc75d4da8 req-c361924c-d219-4de1-831b-1a23ac3e48d1 tempest-AttachVolumeNegativeTest-1071945405 None] Terminate volume connection completed successfully. Sep 09 03:43:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-97bad10a-7e2c-4c28-b2c4-2a7dc75d4da8 req-c361924c-d219-4de1-831b-1a23ac3e48d1 tempest-AttachVolumeNegativeTest-1071945405 None] Deleting attachment d03f998c-9052-4147-8de6-cc5e4efe8117. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:43:42 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 1G" returned: 0 in 0.672s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:42 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:43:42 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:42 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.355s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:42 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 is being set with open permissions: ugo+rw Sep 09 03:43:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:42 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:43:42 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:43 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.391s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:43 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.info Sep 09 03:43:43 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:43 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.info" returned: 0 in 0.687s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:43 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.info is being set with open permissions: ugo+rw Sep 09 03:43:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:44 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.info Sep 09 03:43:44 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:44 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.info" returned: 0 in 0.470s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.531s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:44 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-eb300c7b-0017-47e1-94b0-62954056313f tempest-SnapshotsActionsTest-844924787 None] Create snapshot completed successfully Sep 09 03:43:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Creating offline snapshot 2e5fe307-1624-4dfa-a67d-8963a835f727 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:43:46 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[20364244-d027-4a90-b4f5-ebf3fc63484a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:46 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:43:46 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:47 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.625s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:43:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:47 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 1G Sep 09 03:43:47 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:47 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 1G" returned: 0 in 0.571s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:47 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 Sep 09 03:43:47 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:48 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727" returned: 0 in 0.369s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:48 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 is being set with open permissions: ugo+rw Sep 09 03:43:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:48 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 Sep 09 03:43:48 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:48 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-69f4646d-1f3c-4837-a4d0-82911afc906c tempest-SnapshotsActionsTest-844924787 None] Create snapshot completed successfully Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-2e5fe307-1624-4dfa-a67d-8963a835f727-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-2e5fe307-1624-4dfa-a67d-8963a835f727-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-quobyte-2e5fe307-1624-4dfa-a67d-8963a835f727" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-2e5fe307-1624-4dfa-a67d-8963a835f727" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Deleting offline snapshot 2e5fe307-1624-4dfa-a67d-8963a835f727 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] snapshot_file for this snap is: volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f44659d-fd65-4dae-aa8f-b6cbe0f2015f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:49 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 Sep 09 03:43:49 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:50 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727" returned: 0 in 0.389s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:43:50 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c206a001-fc14-46dc-9029-96b0b35b7916]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:50 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:43:50 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:50 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.448s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:43:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:50 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 Sep 09 03:43:50 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:51 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727" returned: 0 in 0.532s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:51 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727 Sep 09 03:43:51 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:51 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2e5fe307-1624-4dfa-a67d-8963a835f727" returned: 0 in 0.295s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-2e5fe307-1624-4dfa-a67d-8963a835f727" released by "_delete_snapshot" :: held 1.799s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" released by "delete_snapshot" :: held 1.840s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:51 devstack cinder-volume[87597]: WARNING cinder.quota [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:43:51 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Created reservations ['aef0850b-18d3-4562-920e-424852f2163f', '5ad409a5-aecb-4eb9-a965-e14e30e67d21', 'fcf9cdbb-6f98-491e-a7c2-5b4b92575adf', '9abd3255-bdd1-42ba-837d-36c5db5227bd'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:43:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Delete snapshot completed successfully. Sep 09 03:43:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e10d56b-3dba-4834-8921-75824754f9f1 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-2e5fe307-1624-4dfa-a67d-8963a835f727-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Creating offline snapshot 43e31e05-9b90-4427-b990-8fd59f998183 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:43:52 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b83f1f6-d74b-48d5-9ef9-939f027309bf]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:52 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:43:52 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:52 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.575s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:43:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:53 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 1G Sep 09 03:43:53 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:53 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 1G" returned: 0 in 0.844s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:53 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 Sep 09 03:43:53 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:54 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183" returned: 0 in 0.417s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:54 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 is being set with open permissions: ugo+rw Sep 09 03:43:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:54 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 Sep 09 03:43:54 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:54 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183" returned: 0 in 0.573s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:43:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1c977506-3ca0-4eab-8f72-3356a875f10d tempest-SnapshotsActionsTest-844924787 None] Create snapshot completed successfully Sep 09 03:43:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-43e31e05-9b90-4427-b990-8fd59f998183-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-43e31e05-9b90-4427-b990-8fd59f998183-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-quobyte-43e31e05-9b90-4427-b990-8fd59f998183" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:43:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-43e31e05-9b90-4427-b990-8fd59f998183" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:43:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Deleting offline snapshot 43e31e05-9b90-4427-b990-8fd59f998183 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:43:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] snapshot_file for this snap is: volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:43:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[203487de-bab1-4010-8bf1-8ce5073561f4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:56 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 Sep 09 03:43:56 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:56 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183" returned: 0 in 0.735s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:43:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c301d96-46c0-4f1b-9f10-4ff150be6087]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:57 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:43:57 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:57 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.775s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:43:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:57 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 Sep 09 03:43:57 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:58 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183" returned: 0 in 0.611s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:58 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183 Sep 09 03:43:58 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:43:58 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Sep 09 03:43:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.43e31e05-9b90-4427-b990-8fd59f998183" returned: 0 in 0.433s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:43:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-43e31e05-9b90-4427-b990-8fd59f998183" released by "_delete_snapshot" :: held 2.774s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" released by "delete_snapshot" :: held 2.834s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:58 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Created reservations ['02941cd1-8e92-4431-bbd6-5d8b78367aef', 'c56bfb8d-a844-4421-b23b-2dbbdbf34e59', 'e06a167b-ee6a-4b87-825d-6ab7fed748f6', 'e908245c-583c-4d60-b839-7f044066cabb'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:43:58 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Delete snapshot completed successfully. Sep 09 03:43:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1c488228-1390-4865-9b55-34bc6ff032e5 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-43e31e05-9b90-4427-b990-8fd59f998183-delete_snapshot" released by "delete_snapshot" :: held 3.088s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:43:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:43:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:43:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Creating offline snapshot 2a6786af-2d6d-4987-92f1-340a38055fb3 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:43:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca22b55-8ff4-4346-b2d6-a60db2966a81]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:43:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:43:59 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:43:59 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:00 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.604s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:44:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:00 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 1G Sep 09 03:44:00 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:01 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 1G" returned: 0 in 1.324s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:01 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 Sep 09 03:44:01 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:01 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3" returned: 0 in 0.424s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:01 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 is being set with open permissions: ugo+rw Sep 09 03:44:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:01 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 Sep 09 03:44:01 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:02 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3" returned: 0 in 0.730s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.282s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:02 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f6eebd71-dd88-4c50-a166-a75c6d852efa tempest-SnapshotsActionsTest-844924787 None] Create snapshot completed successfully Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-2a6786af-2d6d-4987-92f1-340a38055fb3-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-2a6786af-2d6d-4987-92f1-340a38055fb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-quobyte-2a6786af-2d6d-4987-92f1-340a38055fb3" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-2a6786af-2d6d-4987-92f1-340a38055fb3" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Deleting offline snapshot 2a6786af-2d6d-4987-92f1-340a38055fb3 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] snapshot_file for this snap is: volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[27478f47-f066-4e9a-8711-49dc353c5ad2]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:04 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 Sep 09 03:44:04 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:05 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3" returned: 0 in 0.656s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[654367f8-e506-4994-8974-eed4fd21d38c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:05 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-ce92d282-2006-4d8b-a232-29738c24c131 req-9c95893c-6169-4cc9-8aac-93b8673396bb tempest-ServerActionsTestOtherA-1735223895 None] Terminate volume connection completed successfully. Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-ce92d282-2006-4d8b-a232-29738c24c131 req-9c95893c-6169-4cc9-8aac-93b8673396bb tempest-ServerActionsTestOtherA-1735223895 None] Deleting attachment 79d225ac-6352-44bd-9ca4-832f11add229. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:44:05 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:44:05 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "cinder-0dfcfdc4-6b83-4171-b65a-169e87db6c1d-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Lock "cinder-0dfcfdc4-6b83-4171-b65a-169e87db6c1d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "cinder-quobyte-0dfcfdc4-6b83-4171-b65a-169e87db6c1d" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Lock "cinder-quobyte-0dfcfdc4-6b83-4171-b65a-169e87db6c1d" acquired by "delete_volume" :: waited 0.084s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e253cfc-fe85-4749-b0ea-78a3d2770cd7]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:06 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.931s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:44:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:06 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 Sep 09 03:44:06 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:06 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d Sep 09 03:44:06 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:06 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d" returned: 0 in 0.656s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:06 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d Sep 09 03:44:06 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:07 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3" returned: 0 in 1.019s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:07 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0dfcfdc4-6b83-4171-b65a-169e87db6c1d" returned: 0 in 0.452s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:07 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3 Sep 09 03:44:07 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Lock "cinder-quobyte-0dfcfdc4-6b83-4171-b65a-169e87db6c1d" released by "delete_volume" :: held 1.234s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG cinder.quota [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Created reservations ['fba83a4e-6b35-471f-a0e6-54c72de005c4', 'bd6d2d5c-b62b-49c8-b9b5-825111669826', '29404240-6571-4997-8a92-2a146674da34', 'f573ef20-85cf-491c-bd6c-167eadfeb1de'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:07 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:07 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:07 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.2a6786af-2d6d-4987-92f1-340a38055fb3" returned: 0 in 0.526s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-2a6786af-2d6d-4987-92f1-340a38055fb3" released by "_delete_snapshot" :: held 3.356s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" released by "delete_snapshot" :: held 3.440s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:07 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Created reservations ['859a9f1b-d2bb-4fe4-b539-524f3b7933af', '879ab630-5a5e-4dff-ae68-64f64269f883', '150a25ff-85e3-428a-b06d-1a465544ad38', '2964f0bf-4f35-4a87-a8a9-5d6a136139ab'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Delete snapshot completed successfully. Sep 09 03:44:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bf9cf5aa-a5dd-4afa-a70d-9cf57378a8cb tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-2a6786af-2d6d-4987-92f1-340a38055fb3-delete_snapshot" released by "delete_snapshot" :: held 4.038s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:08 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.863s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:08 devstack cinder-volume[87597]: DEBUG cinder.manager [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Deleted volume successfully. Sep 09 03:44:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-ce92d282-2006-4d8b-a232-29738c24c131 req-795c3881-99b4-4740-b58b-4ee3426589cf tempest-ServerActionsTestOtherA-1735223895 None] Lock "cinder-0dfcfdc4-6b83-4171-b65a-169e87db6c1d-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "cinder-d0752d32-4a9b-4805-b00a-b70653437f3e-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Lock "cinder-d0752d32-4a9b-4805-b00a-b70653437f3e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "cinder-quobyte-d0752d32-4a9b-4805-b00a-b70653437f3e" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Lock "cinder-quobyte-d0752d32-4a9b-4805-b00a-b70653437f3e" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee22f8d1-4cab-4763-b5db-b9909aa13e14]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Creating offline snapshot 0b578823-a9d2-4d45-b7cf-8e37152e05d0 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:44:09 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e Sep 09 03:44:09 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28963c9-e2e2-4fc1-9f67-cc536ba5a78c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:09 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:44:09 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:10 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e" returned: 0 in 0.615s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:10 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e Sep 09 03:44:10 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:10 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.880s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:44:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:10 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 1G Sep 09 03:44:10 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:10 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d0752d32-4a9b-4805-b00a-b70653437f3e" returned: 0 in 0.806s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Lock "cinder-quobyte-d0752d32-4a9b-4805-b00a-b70653437f3e" released by "delete_volume" :: held 1.576s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Created reservations ['31f54823-9c99-42a2-a978-1b435eea9a9f', '6eeb907a-a67e-4bee-ac04-60ff641ee7bf', 'c1c87210-8aec-4500-b1d0-a08bc7fa0d17', '9c395dd8-d107-4ff5-870f-3e210ea724bb'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:11 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:11 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:11 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.345s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:11 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Deleted volume successfully. Sep 09 03:44:11 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 1G" returned: 0 in 1.074s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a1290e5c-cdcd-4969-9b9d-d96be3758903 tempest-ServerActionsTestOtherA-1735223895 None] Lock "cinder-d0752d32-4a9b-4805-b00a-b70653437f3e-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:11 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 Sep 09 03:44:11 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:12 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0" returned: 0 in 0.442s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:12 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 is being set with open permissions: ugo+rw Sep 09 03:44:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:12 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 Sep 09 03:44:12 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:12 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0" returned: 0 in 0.448s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.143s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-52ca1418-33d3-4a97-8e61-1b0aa59c10c9 tempest-SnapshotsActionsTest-844924787 None] Create snapshot completed successfully Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-0b578823-a9d2-4d45-b7cf-8e37152e05d0-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-0b578823-a9d2-4d45-b7cf-8e37152e05d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Acquiring lock "cinder-quobyte-0b578823-a9d2-4d45-b7cf-8e37152e05d0" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-0b578823-a9d2-4d45-b7cf-8e37152e05d0" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Deleting offline snapshot 0b578823-a9d2-4d45-b7cf-8e37152e05d0 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] snapshot_file for this snap is: volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b785a5f4-3c51-4f13-bef4-a8ee65baed29]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:14 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 Sep 09 03:44:14 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:15 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0" returned: 0 in 0.848s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:44:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae1785e-c04c-4d4c-a246-682c006d2046]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:15 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:44:15 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:15 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.574s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:44:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:15 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 Sep 09 03:44:15 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:16 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0" returned: 0 in 0.601s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:16 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0 Sep 09 03:44:16 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:16 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0b578823-a9d2-4d45-b7cf-8e37152e05d0" returned: 0 in 0.278s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-0b578823-a9d2-4d45-b7cf-8e37152e05d0" released by "_delete_snapshot" :: held 2.490s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" released by "delete_snapshot" :: held 2.537s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:16 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Created reservations ['0725acd4-1492-49e0-ba55-f26eef98feff', '3437df67-3fa7-4dfd-8c45-da2f24ad54ed', 'b4c4187a-a6fe-4b65-a286-2b570377dc46', '49ef3c06-cdba-4de3-832a-77f560189c09'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Delete snapshot completed successfully. Sep 09 03:44:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-910f83a3-f370-4d3f-b92c-51f287b3c0e6 tempest-SnapshotsActionsTest-430261116 None] Lock "cinder-0b578823-a9d2-4d45-b7cf-8e37152e05d0-delete_snapshot" released by "delete_snapshot" :: held 2.756s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "cinder-0af23b4f-9858-45f9-a779-6aac537f3826-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-0af23b4f-9858-45f9-a779-6aac537f3826-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "cinder-quobyte-0af23b4f-9858-45f9-a779-6aac537f3826" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-quobyte-0af23b4f-9858-45f9-a779-6aac537f3826" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Deleting offline snapshot 0af23b4f-9858-45f9-a779-6aac537f3826 of volume a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] snapshot_file for this snap is: volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2d67d-efbd-4c80-a8c9-a21455a8195f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:18 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:44:18 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:19 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.670s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:19 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:44:19 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[37833a7c-d93b-429d-b736-2567686b1380]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:19 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 Sep 09 03:44:19 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:19 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" returned: 0 in 0.594s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:19 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:44:19 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:20 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.560s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:20 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826 Sep 09 03:44:20 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:20 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490.0af23b4f-9858-45f9-a779-6aac537f3826" returned: 0 in 0.457s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-quobyte-0af23b4f-9858-45f9-a779-6aac537f3826" released by "_delete_snapshot" :: held 2.476s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" released by "delete_snapshot" :: held 2.511s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:20 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Created reservations ['98e1c31a-27ed-42ac-918e-786d16788d54', 'a15ce9fd-b093-45bd-b137-c62d1feb1043', 'dfa9b8f4-f8b4-44af-a880-8ded0d935f6a', '485c7432-2c24-42cb-9e79-f84a3aceb88e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:21 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Delete snapshot completed successfully. Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2808bd93-cb13-4f71-bbe7-b0ff70f5e659 tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-0af23b4f-9858-45f9-a779-6aac537f3826-delete_snapshot" released by "delete_snapshot" :: held 2.808s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Flow 'volume_create_manager' (e739cc86-5436-4053-abbb-ad4d82d0100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a678f837-5266-4e6c-b9ca-ece175a115e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a678f837-5266-4e6c-b9ca-ece175a115e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1158848252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cbf9bd-6a8e-4810-938d-4d68182581dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d9bf578ae341b7b0594abe9dc2692a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:44:21Z,use_quota=True,user_id='1648ba6f89d54fdb8e688b0ab40d2032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19a1659-b5db-43ca-b1f8-6bdc2fb1fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19a1659-b5db-43ca-b1f8-6bdc2fb1fd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0266351d-7571-4991-9982-17f6511212e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0266351d-7571-4991-9982-17f6511212e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cbf9bd-6a8e-4810-938d-4d68182581dc', 'volume_name': 'volume-41cbf9bd-6a8e-4810-938d-4d68182581dc', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eadb73-5f42-4331-bde9-3aff0193c947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eadb73-5f42-4331-bde9-3aff0193c947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbb3e40-db32-451e-b6d4-222e276b2b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:21 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Volume 41cbf9bd-6a8e-4810-938d-4d68182581dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cbf9bd-6a8e-4810-938d-4d68182581dc', 'volume_size': 1} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1158848252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cbf9bd-6a8e-4810-938d-4d68182581dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d9bf578ae341b7b0594abe9dc2692a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:44:21Z,use_quota=True,user_id='1648ba6f89d54fdb8e688b0ab40d2032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Creating volume 41cbf9bd-6a8e-4810-938d-4d68182581dc {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:44:21 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:21 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc 1073741824 Sep 09 03:44:21 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "cinder-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" acquired by "delete_volume" :: waited 0.050s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:22 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e43da5-f313-473d-b085-d1632574f5cb]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:22 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc 1073741824" returned: 0 in 0.979s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:22 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 Sep 09 03:44:22 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:22 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc Sep 09 03:44:22 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:22 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" returned: 0 in 0.950s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:23 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490 Sep 09 03:44:23 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:23 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc" returned: 0 in 0.769s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbb3e40-db32-451e-b6d4-222e276b2b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cbf9bd-6a8e-4810-938d-4d68182581dc', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffea3da-4163-4827-ba50-7ea244ca533a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:23 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Volume volume-41cbf9bd-6a8e-4810-938d-4d68182581dc (41cbf9bd-6a8e-4810-938d-4d68182581dc): created successfully Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffea3da-4163-4827-ba50-7ea244ca533a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Flow 'volume_create_manager' (e739cc86-5436-4053-abbb-ad4d82d0100b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:44:23 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-16bd6def-dbe1-45a8-aa11-0632781f3815 tempest-ServerRescueNegativeTestJSON-728212131 None] Created volume successfully. Sep 09 03:44:23 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" returned: 0 in 0.460s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-quobyte-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490" released by "delete_volume" :: held 1.518s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Created reservations ['eda80768-4e5a-46e8-be41-7e4afc929bd6', '91b32a40-85d2-493d-82d3-da9259c4edbf', '95c723b3-2c48-4645-a2d4-4b04d0bb8feb', 'f34a724a-4ad7-4ac0-bef8-47566873fa52'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:23 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:23 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:23 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.338s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:23 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:23 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Deleted volume successfully. Sep 09 03:44:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c8a4ecb-1ae5-49dd-8e81-9f64e67c26fd tempest-SnapshotsActionsTest-844924787 None] Lock "cinder-a7c6cfc0-1e7a-4c76-94d2-2c3d4b4ab490-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=72,cinder:UPDATE=73,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Flow 'volume_create_manager' (ff5f76f8-0c73-46bb-af22-93fc9630f157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccf931d-3add-47aa-8489-3fa33d70bf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccf931d-3add-47aa-8489-3fa33d70bf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1833741789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95977c4-2622-4ab8-a83e-80ae06c423a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a06f79f4ba47e4a84bc6b77b477eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:44:29Z,use_quota=True,user_id='daab43ee3be34bcf9d4706b6fa8e12e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c9c3ec-4cef-44f5-9a47-26e1d68c2c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c9c3ec-4cef-44f5-9a47-26e1d68c2c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12e86bb-0bf5-4db5-a33d-4e6e10330267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12e86bb-0bf5-4db5-a33d-4e6e10330267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95977c4-2622-4ab8-a83e-80ae06c423a1', 'volume_name': 'volume-e95977c4-2622-4ab8-a83e-80ae06c423a1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5deb8a-b00f-40ce-9379-4e1a1dd3e5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5deb8a-b00f-40ce-9379-4e1a1dd3e5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba1c8a4-fdeb-4bfd-88e4-1a19a7ea79c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:29 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Volume e95977c4-2622-4ab8-a83e-80ae06c423a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95977c4-2622-4ab8-a83e-80ae06c423a1', 'volume_size': 1} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1833741789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95977c4-2622-4ab8-a83e-80ae06c423a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a06f79f4ba47e4a84bc6b77b477eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:44:29Z,use_quota=True,user_id='daab43ee3be34bcf9d4706b6fa8e12e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Creating volume e95977c4-2622-4ab8-a83e-80ae06c423a1 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:44:29 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:44:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:29 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 1073741824 Sep 09 03:44:29 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:30 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 1073741824" returned: 0 in 0.984s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:30 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 Sep 09 03:44:30 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:30 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1" returned: 0 in 0.429s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:44:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba1c8a4-fdeb-4bfd-88e4-1a19a7ea79c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95977c4-2622-4ab8-a83e-80ae06c423a1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8873a2-6a88-498d-8ef0-2fd5f99a4365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:30 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Volume volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 (e95977c4-2622-4ab8-a83e-80ae06c423a1): created successfully Sep 09 03:44:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8873a2-6a88-498d-8ef0-2fd5f99a4365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Flow 'volume_create_manager' (ff5f76f8-0c73-46bb-af22-93fc9630f157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:44:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c8f6e1bb-5ccb-4c2d-8fb2-3e429bdd1490 tempest-AttachVolumeNegativeTest-1071945405 None] Created volume successfully. Sep 09 03:44:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-01d3224f-e52a-4941-9320-e5f832079689 req-d173eb78-8db6-4e47-9ac2-815d32700b14 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-01d3224f-e52a-4941-9320-e5f832079689 req-d173eb78-8db6-4e47-9ac2-815d32700b14 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-01d3224f-e52a-4941-9320-e5f832079689 req-d173eb78-8db6-4e47-9ac2-815d32700b14 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-01d3224f-e52a-4941-9320-e5f832079689 req-d173eb78-8db6-4e47-9ac2-815d32700b14 tempest-AttachVolumeNegativeTest-1071945405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-e95977c4-2622-4ab8-a83e-80ae06c423a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90875233-98af-43e7-8cdc-53f160bfe25f', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:44:33 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-01d3224f-e52a-4941-9320-e5f832079689 req-d173eb78-8db6-4e47-9ac2-815d32700b14 tempest-AttachVolumeNegativeTest-1071945405 None] attachment_update completed successfully. Sep 09 03:44:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-61936942-b994-42be-83ea-509462e96a34 tempest-GroupSnapshotsV319Test-1464822112 None] Group tempest-GroupSnapshotsV319Test-Group-1119784298: creating Sep 09 03:44:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-61936942-b994-42be-83ea-509462e96a34 tempest-GroupSnapshotsV319Test-1464822112 None] Group tempest-GroupSnapshotsV319Test-Group-1119784298: created successfully Sep 09 03:44:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-61936942-b994-42be-83ea-509462e96a34 tempest-GroupSnapshotsV319Test-1464822112 None] Create group completed successfully. Sep 09 03:44:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Acquiring lock "cinder-41cbf9bd-6a8e-4810-938d-4d68182581dc-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "cinder-41cbf9bd-6a8e-4810-938d-4d68182581dc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Acquiring lock "cinder-quobyte-41cbf9bd-6a8e-4810-938d-4d68182581dc" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "cinder-quobyte-41cbf9bd-6a8e-4810-938d-4d68182581dc" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:36 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16edd1-e456-455e-9263-987dea8d1f5f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:36 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc Sep 09 03:44:36 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:36 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc" returned: 0 in 0.597s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:36 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc Sep 09 03:44:36 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:37 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-41cbf9bd-6a8e-4810-938d-4d68182581dc" returned: 0 in 0.475s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "cinder-quobyte-41cbf9bd-6a8e-4810-938d-4d68182581dc" released by "delete_volume" :: held 1.213s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:37 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:37 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-d299aa1a-e3c1-4b6a-badd-7f8616e82ac1 req-b542d1ec-5fd0-481e-b8d7-4e3f5f0025c2 tempest-AttachVolumeNegativeTest-1071945405 None] Terminate volume connection completed successfully. Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-d299aa1a-e3c1-4b6a-badd-7f8616e82ac1 req-b542d1ec-5fd0-481e-b8d7-4e3f5f0025c2 tempest-AttachVolumeNegativeTest-1071945405 None] Deleting attachment 90875233-98af-43e7-8cdc-53f160bfe25f. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=84,cinder:UPDATE=71,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Created reservations ['334592f5-9202-4077-8493-1b08b2bac4f8', '4c37277d-31c4-403c-b009-a54df63f48f7', '23c4df7f-7f55-46de-9912-1a707df11b9f', 'a43ae9e1-09fe-4003-bf76-01461630470b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:37 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:37 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:37 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.598s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:44:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Flow 'volume_create_manager' (78c91327-9c77-4deb-b7c8-64c4c4693917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb243e6b-2c03-4c60-969a-b3e2fa238b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb243e6b-2c03-4c60-969a-b3e2fa238b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-202295756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=535de8b3-ad02-4055-9e27-399b65c15be4,host='devstack@QuobyteHD#QuobyteHD',id=ddc2595d-0f07-4046-8ac4-424c4b18a328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b00aa946fdc406c9e3c6b1d55e865da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:44:38Z,use_quota=True,user_id='15ffbd4a4f294ab2a239ec0703691fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48f1ba59-3eb0-46f7-a85a-5c3f82b8e97b),volume_type_id=48f1ba59-3eb0-46f7-a85a-5c3f82b8e97b)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4cb700-b7ea-4b26-b8ad-0b9a7c7a8b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4cb700-b7ea-4b26-b8ad-0b9a7c7a8b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5433cd0c-6d2c-42ce-8058-31130771c4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5433cd0c-6d2c-42ce-8058-31130771c4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc2595d-0f07-4046-8ac4-424c4b18a328', 'volume_name': 'volume-ddc2595d-0f07-4046-8ac4-424c4b18a328', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da385f6-8726-4034-a114-43ee4d90c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da385f6-8726-4034-a114-43ee4d90c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045d2385-c395-4399-b77d-3bda9bdb8295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Volume ddc2595d-0f07-4046-8ac4-424c4b18a328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc2595d-0f07-4046-8ac4-424c4b18a328', 'volume_size': 1} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=535de8b3-ad02-4055-9e27-399b65c15be4,created_at=2026-09-09T01:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-202295756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=535de8b3-ad02-4055-9e27-399b65c15be4,host='devstack@QuobyteHD#QuobyteHD',id=ddc2595d-0f07-4046-8ac4-424c4b18a328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b00aa946fdc406c9e3c6b1d55e865da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:44:38Z,use_quota=True,user_id='15ffbd4a4f294ab2a239ec0703691fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48f1ba59-3eb0-46f7-a85a-5c3f82b8e97b),volume_type_id=48f1ba59-3eb0-46f7-a85a-5c3f82b8e97b)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Creating volume ddc2595d-0f07-4046-8ac4-424c4b18a328 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:44:38 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:38 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.557s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:38 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Deleted volume successfully. Sep 09 03:44:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70ff5f3b-4ae1-4024-8187-d7bca58ae15d tempest-ServerRescueNegativeTestJSON-728212131 None] Lock "cinder-41cbf9bd-6a8e-4810-938d-4d68182581dc-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:38 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 1073741824 Sep 09 03:44:38 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:39 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 1073741824" returned: 0 in 1.296s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:39 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 Sep 09 03:44:39 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:40 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328" returned: 0 in 0.506s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:44:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045d2385-c395-4399-b77d-3bda9bdb8295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc2595d-0f07-4046-8ac4-424c4b18a328', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ea2d0b-eb14-4251-8886-19f7605a9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:40 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Volume volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 (ddc2595d-0f07-4046-8ac4-424c4b18a328): created successfully Sep 09 03:44:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ea2d0b-eb14-4251-8886-19f7605a9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Flow 'volume_create_manager' (78c91327-9c77-4deb-b7c8-64c4c4693917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:44:40 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-078c4567-4ae8-469b-9e74-975b4a6d57a0 tempest-GroupSnapshotsV319Test-1464822112 None] Created volume successfully. Sep 09 03:44:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] GroupSnapshot 5c883277-59b8-4b7e-bc4d-116f5b81e1e0: creating. Sep 09 03:44:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Group snapshot 5c883277-59b8-4b7e-bc4d-116f5b81e1e0: creating. {{(pid=87597) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 03:44:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Creating offline snapshot 9331aaea-8778-4c45-b7a5-8791aef3aa2c of volume ddc2595d-0f07-4046-8ac4-424c4b18a328 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:44:41 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5839fc7-03ed-4bba-8ec4-b290d9f34407]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:41 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 Sep 09 03:44:41 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:42 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328" returned: 0 in 0.721s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:42 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c 1G Sep 09 03:44:42 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:43 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c 1G" returned: 0 in 0.977s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:43 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c Sep 09 03:44:43 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:43 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c" returned: 0 in 0.523s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:43 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:44:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:43 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c Sep 09 03:44:43 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:44 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c" returned: 0 in 0.523s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:44 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.info Sep 09 03:44:44 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:44 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.info" returned: 0 in 0.414s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:44 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:44 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.info Sep 09 03:44:44 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "cinder-e95977c4-2622-4ab8-a83e-80ae06c423a1-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-e95977c4-2622-4ab8-a83e-80ae06c423a1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "cinder-quobyte-e95977c4-2622-4ab8-a83e-80ae06c423a1" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-quobyte-e95977c4-2622-4ab8-a83e-80ae06c423a1" acquired by "delete_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:44 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.info" returned: 0 in 0.386s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.687s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:45 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8555aaa1-e2ed-4ad4-bda3-0e2ee3a688fb]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-73b4cf9c-3eeb-4090-91d9-d76057e38f49 tempest-GroupSnapshotsV319Test-1464822112 None] group_snapshot 5c883277-59b8-4b7e-bc4d-116f5b81e1e0: created successfully Sep 09 03:44:45 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 Sep 09 03:44:45 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:45 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1" returned: 0 in 0.493s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:45 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1 Sep 09 03:44:45 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:45 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e95977c4-2622-4ab8-a83e-80ae06c423a1" returned: 0 in 0.371s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:45 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-quobyte-e95977c4-2622-4ab8-a83e-80ae06c423a1" released by "delete_volume" :: held 0.993s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Created reservations ['8f762e91-01f2-484e-a713-931928d03649', '8e067e7c-38cd-425b-ba06-a976fd5003b6', '4c73226d-5cac-42b0-b6f9-5dbe94b7eea5', 'd5e5ea2a-7da6-4f7f-b00d-9fd3a26ca274'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:46 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:46 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:46 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] group_snapshot 5c883277-59b8-4b7e-bc4d-116f5b81e1e0: deleting Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.497s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Deleted volume successfully. Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] group_snapshot 5c883277-59b8-4b7e-bc4d-116f5b81e1e0: deleting {{(pid=87597) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Acquiring lock "cinder-quobyte-ddc2595d-0f07-4046-8ac4-424c4b18a328" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-84430914-f9f7-4c6a-affe-4d07266769a5 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-e95977c4-2622-4ab8-a83e-80ae06c423a1-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "cinder-quobyte-ddc2595d-0f07-4046-8ac4-424c4b18a328" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Acquiring lock "cinder-quobyte-9331aaea-8778-4c45-b7a5-8791aef3aa2c" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "cinder-quobyte-9331aaea-8778-4c45-b7a5-8791aef3aa2c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Deleting offline snapshot 9331aaea-8778-4c45-b7a5-8791aef3aa2c of volume ddc2595d-0f07-4046-8ac4-424c4b18a328 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] snapshot_file for this snap is: volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1013e501-4d38-475a-8103-e802b3066324]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:47 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c Sep 09 03:44:47 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "cinder-7f78f872-f6cf-4741-a617-28c212d9f394-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-7f78f872-f6cf-4741-a617-28c212d9f394-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "cinder-quobyte-7f78f872-f6cf-4741-a617-28c212d9f394" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-quobyte-7f78f872-f6cf-4741-a617-28c212d9f394" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:47 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c" returned: 0 in 0.648s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc2595d-0f07-4046-8ac4-424c4b18a328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d200e3-82c8-47e9-8df6-0a0b11af32c6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a43d23-7528-465c-b766-3ce583e1254f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:47 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 Sep 09 03:44:47 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:47 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 Sep 09 03:44:47 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:48 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394" returned: 0 in 0.528s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:48 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:48 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394 Sep 09 03:44:48 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328" returned: 0 in 0.559s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:48 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c Sep 09 03:44:48 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:48 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f78f872-f6cf-4741-a617-28c212d9f394" returned: 0 in 0.346s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-quobyte-7f78f872-f6cf-4741-a617-28c212d9f394" released by "delete_volume" :: held 0.944s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Created reservations ['964daa45-5d43-43e0-a5bd-abe4413c4fa8', 'b66c5a79-2cd9-4184-86c7-d943aa2a5a03', '3c8eacd3-eca3-4826-a85b-0b8196c656dd', 'cebd8a2c-6699-4741-8717-f8a9a5a691c6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:48 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c" returned: 0 in 0.399s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:48 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c Sep 09 03:44:48 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:48 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:48 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:48 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328.9331aaea-8778-4c45-b7a5-8791aef3aa2c" returned: 0 in 0.285s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "cinder-quobyte-9331aaea-8778-4c45-b7a5-8791aef3aa2c" released by "_delete_snapshot" :: held 2.080s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:48 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.295s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Deleted volume successfully. Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "cinder-quobyte-ddc2595d-0f07-4046-8ac4-424c4b18a328" released by "delete_snapshot" :: held 2.126s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-61b1ec2d-645e-44e0-8ee1-95a1fdeb31b6 tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-7f78f872-f6cf-4741-a617-28c212d9f394-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:49 devstack cinder-volume[87597]: WARNING cinder.quota [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-548369966 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-548369966, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:44:49 devstack cinder-volume[87597]: WARNING cinder.quota [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-548369966 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-548369966, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:44:49 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] Created reservations ['c77c1d3f-90f0-40a8-a77d-ec2e4715ff83', '04921903-9566-44a8-bf9f-ce778bea1756', 'dee8b7c7-8b10-4212-900e-7cd1d409f74d', '7c87cad3-3f3d-4131-9db6-3effda6e7b4b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b145c3f6-fde9-483a-8ade-1a58afeb3706 tempest-GroupSnapshotsV319Test-1464822112 None] group_snapshot 5c883277-59b8-4b7e-bc4d-116f5b81e1e0: deleted successfully Sep 09 03:44:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Acquiring lock "cinder-quobyte-ddc2595d-0f07-4046-8ac4-424c4b18a328" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "cinder-quobyte-ddc2595d-0f07-4046-8ac4-424c4b18a328" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[91374895-3b5b-47cb-a334-da99c10eb347]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:49 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 Sep 09 03:44:49 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "cinder-7f556ec8-8362-44c4-a494-6b46fb22a2cb-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-7f556ec8-8362-44c4-a494-6b46fb22a2cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "cinder-quobyte-7f556ec8-8362-44c4-a494-6b46fb22a2cb" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-quobyte-7f556ec8-8362-44c4-a494-6b46fb22a2cb" acquired by "delete_volume" :: waited 0.038s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d3ece6-67dc-41ce-94df-5431a8b6543e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:50 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328" returned: 0 in 0.673s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:50 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328 Sep 09 03:44:50 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:50 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb Sep 09 03:44:50 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:50 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddc2595d-0f07-4046-8ac4-424c4b18a328" returned: 0 in 0.345s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "cinder-quobyte-ddc2595d-0f07-4046-8ac4-424c4b18a328" released by "delete_volume" :: held 1.125s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:50 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb" returned: 0 in 0.478s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:50 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb Sep 09 03:44:50 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Created reservations ['2e5498fa-8d00-43ab-ba0f-60d6d0c68418'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:50 devstack cinder-volume[87597]: WARNING cinder.quota [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-548369966 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-548369966, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:44:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Created reservations ['cc58496d-3dc7-47d8-8e87-ba53ee4e6941', '5a26c013-6382-445d-9a1e-d8e9bdd31d8c', '2522c38c-1099-4ca4-877e-8f41cb050b45', '50e7129c-726d-4946-a469-1c79c9f96c87'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:51 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7f556ec8-8362-44c4-a494-6b46fb22a2cb" returned: 0 in 0.406s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:51 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:51 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-quobyte-7f556ec8-8362-44c4-a494-6b46fb22a2cb" released by "delete_volume" :: held 0.939s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Created reservations ['c73b4ff8-9a37-4d1a-a132-e6d66faee62f', '8ebf4a07-1cbb-432e-9b0d-0dddf17bbe4e', '5d309a8b-5c56-4c6f-8bcc-62dca04b7825', 'c1409ef4-5d9f-4008-9689-7f5c47f2b9b6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:51 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:51 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:51 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.335s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b78570af-e8a9-48a7-aca3-9c6f6eeb85c8 tempest-GroupSnapshotsV319Test-1464822112 None] Delete group completed successfully. Sep 09 03:44:51 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.293s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Deleted volume successfully. Sep 09 03:44:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d6396998-22ac-47b0-9d9b-e6328a7f232f tempest-AttachVolumeNegativeTest-1071945405 None] Lock "cinder-7f556ec8-8362-44c4-a494-6b46fb22a2cb-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Flow 'volume_create_manager' (4d23a0e7-feba-48b4-b942-67147be773cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbbcf0a-a877-41dd-a709-874efc60cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbbcf0a-a877-41dd-a709-874efc60cf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1430831832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f35020-ff58-442d-9084-7f4bd9586a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c134d7ce41dd48f8b082dddd7e184007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:44:56Z,use_quota=True,user_id='1e54346f7c194737931359bcc5a50cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a32ac24-11b1-4683-8802-852e8a36415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a32ac24-11b1-4683-8802-852e8a36415f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd03d5-436c-4581-b841-9d4d36699f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd03d5-436c-4581-b841-9d4d36699f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f35020-ff58-442d-9084-7f4bd9586a37', 'volume_name': 'volume-10f35020-ff58-442d-9084-7f4bd9586a37', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69edb49f-a01f-4aa3-959f-854eafa9a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69edb49f-a01f-4aa3-959f-854eafa9a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df194552-24c5-409a-a969-0ba73d1ff9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:56 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Volume 10f35020-ff58-442d-9084-7f4bd9586a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f35020-ff58-442d-9084-7f4bd9586a37', 'volume_size': 1} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1430831832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f35020-ff58-442d-9084-7f4bd9586a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c134d7ce41dd48f8b082dddd7e184007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:44:56Z,use_quota=True,user_id='1e54346f7c194737931359bcc5a50cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Creating volume 10f35020-ff58-442d-9084-7f4bd9586a37 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:44:56 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:56 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 1073741824 Sep 09 03:44:56 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:56 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 1073741824" returned: 0 in 0.637s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:57 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 Sep 09 03:44:57 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:57 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37" returned: 0 in 0.387s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:44:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df194552-24c5-409a-a969-0ba73d1ff9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f35020-ff58-442d-9084-7f4bd9586a37', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba5ba37-a1d8-40a0-a38a-b099653adde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:44:57 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Volume volume-10f35020-ff58-442d-9084-7f4bd9586a37 (10f35020-ff58-442d-9084-7f4bd9586a37): created successfully Sep 09 03:44:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba5ba37-a1d8-40a0-a38a-b099653adde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:44:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Flow 'volume_create_manager' (4d23a0e7-feba-48b4-b942-67147be773cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:44:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-782162f9-3a4b-4680-a2d7-1d626983a9de tempest-VolumesServicesTestJSON-453406499 None] Created volume successfully. Sep 09 03:44:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Acquiring lock "cinder-10f35020-ff58-442d-9084-7f4bd9586a37-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Lock "cinder-10f35020-ff58-442d-9084-7f4bd9586a37-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Acquiring lock "cinder-quobyte-10f35020-ff58-442d-9084-7f4bd9586a37" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:44:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Lock "cinder-quobyte-10f35020-ff58-442d-9084-7f4bd9586a37" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:44:58 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5fbf2b-28f8-4f90-80aa-db93fffe5d0a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:44:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:58 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 Sep 09 03:44:58 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:59 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37" returned: 0 in 0.479s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:59 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37 Sep 09 03:44:59 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:59 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-10f35020-ff58-442d-9084-7f4bd9586a37" returned: 0 in 0.284s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Lock "cinder-quobyte-10f35020-ff58-442d-9084-7f4bd9586a37" released by "delete_volume" :: held 0.827s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Created reservations ['4805357d-4cca-40e6-b633-e3c10dda6472', '8e0c838e-1f81-4caa-a1a6-88de533aff6b', '9d778941-5da9-4a9f-b178-e142e1d22917', '097b0b84-0481-4280-bf96-d5755ae46747'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:44:59 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:44:59 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:44:59 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.331s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:44:59 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:44:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Deleted volume successfully. Sep 09 03:45:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3f6af549-b960-4869-8f3f-13c5cbd8741a tempest-VolumesServicesTestJSON-453406499 None] Lock "cinder-10f35020-ff58-442d-9084-7f4bd9586a37-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Flow 'volume_create_manager' (c452cc81-46ef-4e89-bcad-0926a60e8a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a7b6f6-00b9-4d20-9d02-8ecec2b89229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a7b6f6-00b9-4d20-9d02-8ecec2b89229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-918446218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66ce33a-4b11-4710-9729-e55dc822ffcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5daebacfc0934d0f9c6508c0e707ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:02Z,use_quota=True,user_id='0337ac18b50346d9b8175db0b98613c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc14ba1c-3c38-4821-b900-d8db16044a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc14ba1c-3c38-4821-b900-d8db16044a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d164cb8-167e-4a43-80d6-76d83d894461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d164cb8-167e-4a43-80d6-76d83d894461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b66ce33a-4b11-4710-9729-e55dc822ffcd', 'volume_name': 'volume-b66ce33a-4b11-4710-9729-e55dc822ffcd', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4446ce8b-067f-44f0-8564-925283de44f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4446ce8b-067f-44f0-8564-925283de44f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5031a20a-017e-4d1a-96d5-73f89fa5038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:02 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Volume b66ce33a-4b11-4710-9729-e55dc822ffcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b66ce33a-4b11-4710-9729-e55dc822ffcd', 'volume_size': 1} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-918446218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66ce33a-4b11-4710-9729-e55dc822ffcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5daebacfc0934d0f9c6508c0e707ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:02Z,use_quota=True,user_id='0337ac18b50346d9b8175db0b98613c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Creating volume b66ce33a-4b11-4710-9729-e55dc822ffcd {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:02 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:02 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd 1073741824 Sep 09 03:45:02 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:03 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd 1073741824" returned: 0 in 0.796s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:03 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd Sep 09 03:45:03 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Flow 'volume_create_manager' (3ae586ee-9d62-45f3-ad92-586fab8123c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d9808c-35ae-4a39-9aa6-da98bbb4afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d9808c-35ae-4a39-9aa6-da98bbb4afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-680135690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca9bee4-5d94-4c16-af51-8e2e3bab36d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0474808f595641f38c1a917343d39cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:03Z,use_quota=True,user_id='176c3c0210924fe0a2602a46b2ca6640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c319d43-0a91-4fcf-9453-b85e182acd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c319d43-0a91-4fcf-9453-b85e182acd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0912183-8426-4ef7-8ee3-943dfbf7fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0912183-8426-4ef7-8ee3-943dfbf7fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fca9bee4-5d94-4c16-af51-8e2e3bab36d1', 'volume_name': 'volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8138f20-6f1c-4971-b17e-e9d464cc1e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8138f20-6f1c-4971-b17e-e9d464cc1e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1985ad69-4cff-4b1b-b3e9-e3c19c70b448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:03 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Volume fca9bee4-5d94-4c16-af51-8e2e3bab36d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1', 'volume_size': 1} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:03 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd" returned: 0 in 0.338s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-680135690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca9bee4-5d94-4c16-af51-8e2e3bab36d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0474808f595641f38c1a917343d39cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:03Z,use_quota=True,user_id='176c3c0210924fe0a2602a46b2ca6640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Creating volume fca9bee4-5d94-4c16-af51-8e2e3bab36d1 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:03 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5031a20a-017e-4d1a-96d5-73f89fa5038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66ce33a-4b11-4710-9729-e55dc822ffcd', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:03 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 1073741824 Sep 09 03:45:03 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e183914-88e4-433f-ab83-71c8682e3358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:03 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Volume volume-b66ce33a-4b11-4710-9729-e55dc822ffcd (b66ce33a-4b11-4710-9729-e55dc822ffcd): created successfully Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e183914-88e4-433f-ab83-71c8682e3358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Flow 'volume_create_manager' (c452cc81-46ef-4e89-bcad-0926a60e8a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-da7501a5-189f-4075-bacb-316a158e2cb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Created volume successfully. Sep 09 03:45:04 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 1073741824" returned: 0 in 0.586s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:04 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 Sep 09 03:45:04 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:04 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" returned: 0 in 0.381s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.038s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1985ad69-4cff-4b1b-b3e9-e3c19c70b448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d119fd1-ef9b-4a4a-9951-162e4fc2d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Creating offline snapshot a288e8e7-820f-4d01-bb71-23ec93fe1feb of volume b66ce33a-4b11-4710-9729-e55dc822ffcd {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:45:04 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Volume volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 (fca9bee4-5d94-4c16-af51-8e2e3bab36d1): created successfully Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d119fd1-ef9b-4a4a-9951-162e4fc2d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Flow 'volume_create_manager' (3ae586ee-9d62-45f3-ad92-586fab8123c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e666496f-5edc-4596-b811-cdff18c119d0]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-b73cd61d-3651-483b-b760-afd2a87a85a9 req-49b72458-5eb6-46c9-a3d5-d96a745b4a66 tempest-VolumesSnapshotsTestJSON-2033761245 None] Created volume successfully. Sep 09 03:45:04 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd Sep 09 03:45:04 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:04 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd" returned: 0 in 0.426s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:05 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb 1G Sep 09 03:45:05 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:05 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb 1G" returned: 0 in 0.546s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66ce33a-4b11-4710-9729-e55dc822ffcd -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:05 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66ce33a-4b11-4710-9729-e55dc822ffcd -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb Sep 09 03:45:05 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:06 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66ce33a-4b11-4710-9729-e55dc822ffcd -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb" returned: 0 in 0.495s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:06 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb is being set with open permissions: ugo+rw Sep 09 03:45:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:06 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb Sep 09 03:45:06 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:06 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb" returned: 0 in 0.372s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:06 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.info Sep 09 03:45:06 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:06 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.info" returned: 0 in 0.307s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:06 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.info is being set with open permissions: ugo+rw Sep 09 03:45:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:06 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.info Sep 09 03:45:06 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:07 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.info" returned: 0 in 0.290s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.289s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Creating offline snapshot 8f7ea803-e93f-42c9-94ff-f5bb7f85d353 of volume fca9bee4-5d94-4c16-af51-8e2e3bab36d1 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:45:07 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6c090e-518f-4fa5-a8d2-6f6a9f1e14e5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-87c6ac59-cdf3-4e89-b8b2-1ff11931bd91 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Create snapshot completed successfully Sep 09 03:45:07 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 Sep 09 03:45:07 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:07 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" returned: 0 in 0.485s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:07 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 1G Sep 09 03:45:07 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Flow 'volume_create_manager' (e83451a2-c6b9-411a-855b-ce4d6198513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:08 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15011e1-08f8-4870-b0ba-7a4ea1c0f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 1G" returned: 0 in 0.603s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "cinder-a288e8e7-820f-4d01-bb71-23ec93fe1feb-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15011e1-08f8-4870-b0ba-7a4ea1c0f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1123307334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2567c0b7-5f9d-455d-b0a2-c31b4fe88038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944dd44ea87b447d81c3110905130af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:08Z,use_quota=True,user_id='f9d20069f5e0497cbe430cf91995c48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62d9ee54-2354-44b9-a4ba-59c80ea978d5),volume_type_id=62d9ee54-2354-44b9-a4ba-59c80ea978d5)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62edc5d5-127c-482c-afcf-6f37d6809a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62edc5d5-127c-482c-afcf-6f37d6809a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:08 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beb3ac5-9ebb-4758-886f-5e0b509cb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:08 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9beb3ac5-9ebb-4758-886f-5e0b509cb540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2567c0b7-5f9d-455d-b0a2-c31b4fe88038', 'volume_name': 'volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7564f4-69ea-4fa1-8f6d-a832df84e622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7564f4-69ea-4fa1-8f6d-a832df84e622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7394e80-de53-449c-91e5-fc13ad3a9501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:08 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Volume 2567c0b7-5f9d-455d-b0a2-c31b4fe88038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038', 'volume_size': 1} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-a288e8e7-820f-4d01-bb71-23ec93fe1feb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "cinder-quobyte-b66ce33a-4b11-4710-9729-e55dc822ffcd" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-quobyte-b66ce33a-4b11-4710-9729-e55dc822ffcd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "cinder-quobyte-a288e8e7-820f-4d01-bb71-23ec93fe1feb" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-quobyte-a288e8e7-820f-4d01-bb71-23ec93fe1feb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Deleting offline snapshot a288e8e7-820f-4d01-bb71-23ec93fe1feb of volume b66ce33a-4b11-4710-9729-e55dc822ffcd {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] snapshot_file for this snap is: volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8990b7b-b47e-4d80-8167-634b8c89a508]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:08 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb Sep 09 03:45:08 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:08 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353" returned: 0 in 0.362s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:08 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 is being set with open permissions: ugo+rw Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:08 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 Sep 09 03:45:08 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:08 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb" returned: 0 in 0.412s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b66ce33a-4b11-4710-9729-e55dc822ffcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e7c45d-4ddb-4330-8d10-caac05218312]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:08 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353" returned: 0 in 0.267s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:08 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.info Sep 09 03:45:08 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:08 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd Sep 09 03:45:08 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:09 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.info" returned: 0 in 0.318s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:09 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.info is being set with open permissions: ugo+rw Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:09 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.info Sep 09 03:45:09 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:09 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd" returned: 0 in 0.446s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:09 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb Sep 09 03:45:09 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:09 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.info" returned: 0 in 0.265s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1123307334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2567c0b7-5f9d-455d-b0a2-c31b4fe88038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='944dd44ea87b447d81c3110905130af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:08Z,use_quota=True,user_id='f9d20069f5e0497cbe430cf91995c48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62d9ee54-2354-44b9-a4ba-59c80ea978d5),volume_type_id=62d9ee54-2354-44b9-a4ba-59c80ea978d5)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Creating volume 2567c0b7-5f9d-455d-b0a2-c31b4fe88038 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:09 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:09 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 1073741824 Sep 09 03:45:09 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-b2511e42-b471-419a-9d9a-5dc0535f7700 req-57691e36-b2e1-4917-8904-d763debe9318 tempest-VolumesSnapshotsTestJSON-2033761245 None] Create snapshot completed successfully Sep 09 03:45:09 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb" returned: 0 in 0.415s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:09 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb Sep 09 03:45:09 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "cinder-8f7ea803-e93f-42c9-94ff-f5bb7f85d353-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-8f7ea803-e93f-42c9-94ff-f5bb7f85d353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "cinder-quobyte-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-quobyte-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "cinder-quobyte-8f7ea803-e93f-42c9-94ff-f5bb7f85d353" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-quobyte-8f7ea803-e93f-42c9-94ff-f5bb7f85d353" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Deleting offline snapshot 8f7ea803-e93f-42c9-94ff-f5bb7f85d353 of volume fca9bee4-5d94-4c16-af51-8e2e3bab36d1 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] snapshot_file for this snap is: volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c952a810-896d-4ab3-86dc-28c96c3541da]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:09 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd.a288e8e7-820f-4d01-bb71-23ec93fe1feb" returned: 0 in 0.323s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:10 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 Sep 09 03:45:10 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-quobyte-a288e8e7-820f-4d01-bb71-23ec93fe1feb" released by "_delete_snapshot" :: held 1.717s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-quobyte-b66ce33a-4b11-4710-9729-e55dc822ffcd" released by "delete_snapshot" :: held 1.752s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:10 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 1073741824" returned: 0 in 0.603s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Created reservations ['39235402-137e-4f0c-9caf-193871ec9410', 'b36fa3c3-b0c9-4a64-b02e-06d828db7dfd', 'd8abbcd0-fb86-438d-a2d2-0a09e55c5425', 'd7100748-d6a6-4388-9e60-49a212a9b549'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:10 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 Sep 09 03:45:10 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Delete snapshot completed successfully. Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-142c625e-800b-4f4f-bae2-cde2aaddb326 tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-a288e8e7-820f-4d01-bb71-23ec93fe1feb-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:10 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353" returned: 0 in 0.493s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8752483c-59f1-4c5f-8b5e-fdc4e92045ac]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "cinder-b66ce33a-4b11-4710-9729-e55dc822ffcd-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:10 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038" returned: 0 in 0.384s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-b66ce33a-4b11-4710-9729-e55dc822ffcd-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:10 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 Sep 09 03:45:10 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7394e80-de53-449c-91e5-fc13ad3a9501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e460958-bd08-4ff3-8e4d-4e66ea4474f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Volume volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 (2567c0b7-5f9d-455d-b0a2-c31b4fe88038): created successfully Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e460958-bd08-4ff3-8e4d-4e66ea4474f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Flow 'volume_create_manager' (e83451a2-c6b9-411a-855b-ce4d6198513e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "cinder-quobyte-b66ce33a-4b11-4710-9729-e55dc822ffcd" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2a7a7fe7-cb33-4973-84f8-1807700c6629 tempest-VolumeTypesAccessTest-1217543265 None] Created volume successfully. Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-quobyte-b66ce33a-4b11-4710-9729-e55dc822ffcd" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15335b7-9bf0-4ef2-883f-91b97eafc68e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:10 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd Sep 09 03:45:10 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:10 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" returned: 0 in 0.532s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:10 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 Sep 09 03:45:10 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:11 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd" returned: 0 in 0.447s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:11 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd Sep 09 03:45:11 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:11 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Acquiring lock "cinder-2567c0b7-5f9d-455d-b0a2-c31b4fe88038-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353" returned: 0 in 0.479s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Lock "cinder-2567c0b7-5f9d-455d-b0a2-c31b4fe88038-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:11 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353 Sep 09 03:45:11 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Acquiring lock "cinder-quobyte-2567c0b7-5f9d-455d-b0a2-c31b4fe88038" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Lock "cinder-quobyte-2567c0b7-5f9d-455d-b0a2-c31b4fe88038" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd13cd54-1d07-4bff-bf00-3a6a20d2372a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:11 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b66ce33a-4b11-4710-9729-e55dc822ffcd" returned: 0 in 0.374s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-quobyte-b66ce33a-4b11-4710-9729-e55dc822ffcd" released by "delete_volume" :: held 0.879s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Created reservations ['f05de1b3-ba44-46c8-937e-7b3566a3eb88', '9310e97f-1427-484b-90cc-387a2228e61a', 'b4878eb1-5496-4de5-b0f0-dd8bd390a498', '269250ae-998f-44bd-87ba-a9146ddc9ee8'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:11 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 Sep 09 03:45:11 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:11 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1.8f7ea803-e93f-42c9-94ff-f5bb7f85d353" returned: 0 in 0.363s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:11 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:45:11 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-quobyte-8f7ea803-e93f-42c9-94ff-f5bb7f85d353" released by "_delete_snapshot" :: held 2.035s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-quobyte-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" released by "delete_snapshot" :: held 2.072s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:11 devstack cinder-volume[87597]: DEBUG cinder.quota [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Created reservations ['1edfaccc-d687-4465-8ffd-dcbfb4bc4d16', 'b6ab5f1b-ff42-485c-8aaa-63f03bd3dfa9', '347e7a49-bcd1-4d7a-b04d-e34a017d257f', '92218c69-a00e-4a3b-9a28-e717d2101cc5'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:12 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038" returned: 0 in 0.477s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Delete snapshot completed successfully. Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-8ba237ab-d2d5-4f99-bf6c-e26eb380c70d req-1381d251-8f93-4d44-83ed-ab72bb04cf5e tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-8f7ea803-e93f-42c9-94ff-f5bb7f85d353-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:12 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038 Sep 09 03:45:12 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:12 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:45:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Deleted volume successfully. Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3aae3b2f-6079-49a5-9fbf-fcd2f5ef295b tempest-VolumeSnapshotQuotasNegativeTestJSON-415990433 None] Lock "cinder-b66ce33a-4b11-4710-9729-e55dc822ffcd-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:12 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2567c0b7-5f9d-455d-b0a2-c31b4fe88038" returned: 0 in 0.284s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Lock "cinder-quobyte-2567c0b7-5f9d-455d-b0a2-c31b4fe88038" released by "delete_volume" :: held 0.813s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:12 devstack cinder-volume[87597]: WARNING cinder.quota [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1565513258 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1565513258, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:45:12 devstack cinder-volume[87597]: WARNING cinder.quota [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1565513258 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1565513258, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Created reservations ['093583cd-08e7-48e5-bc3b-f131b399cea1', '67425997-ac7b-48d0-b6c6-f571517e31a0', '3382aef8-e122-451e-8ab4-66563b8ff256', '193e0710-f32e-43c8-84c6-24912bb88feb'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:12 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:45:12 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:12 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.281s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:45:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Deleted volume successfully. Sep 09 03:45:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f50adc01-851d-4c89-981e-895e0012e42b tempest-VolumeTypesAccessTest-1217543265 None] Lock "cinder-2567c0b7-5f9d-455d-b0a2-c31b4fe88038-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "cinder-fca9bee4-5d94-4c16-af51-8e2e3bab36d1-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-fca9bee4-5d94-4c16-af51-8e2e3bab36d1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "cinder-quobyte-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-quobyte-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eece4b-03a5-4ff8-8d82-e8dba33d3b0b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:13 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 Sep 09 03:45:13 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:13 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" returned: 0 in 0.425s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:13 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1 Sep 09 03:45:13 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:14 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" returned: 0 in 0.330s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-quobyte-fca9bee4-5d94-4c16-af51-8e2e3bab36d1" released by "delete_volume" :: held 0.853s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG cinder.quota [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Created reservations ['c17d060c-6267-4051-9900-535fe100f023', '47435df8-8142-4d9a-ad3b-85bfe943eb25', '22bd2661-e31a-4be5-8877-bfd87a719bf3', 'b3e2865c-6217-48b4-b23e-91746d8e4f4d'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:14 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:45:14 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:14 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.396s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG cinder.manager [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:45:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Deleted volume successfully. Sep 09 03:45:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-c74a4bfd-5986-40b5-8955-6c963fc9e737 req-08724ad3-2d67-4bc5-8552-a0191e10529f tempest-VolumesSnapshotsTestJSON-2033761245 None] Lock "cinder-fca9bee4-5d94-4c16-af51-8e2e3bab36d1-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Flow 'volume_create_manager' (7c8d3898-6f70-496c-8d22-e43d6f88c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d71d0c-799f-404e-ac36-b05ddb4024e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d71d0c-799f-404e-ac36-b05ddb4024e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2057744735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694821bb-91e8-4f0e-a60b-f6b86d16365e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='433aba1f4bb44148a697327d8ab8e3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:22Z,use_quota=True,user_id='487b9d5d03cb45e3958f856ca52fc0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5306399f-1520-48d1-9b6c-c85047f6ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5306399f-1520-48d1-9b6c-c85047f6ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5c710f-37ca-48c4-8d4c-467b2aac6545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5c710f-37ca-48c4-8d4c-467b2aac6545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694821bb-91e8-4f0e-a60b-f6b86d16365e', 'volume_name': 'volume-694821bb-91e8-4f0e-a60b-f6b86d16365e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10eba48-4a9b-4bbd-9e50-96d9e1efd870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10eba48-4a9b-4bbd-9e50-96d9e1efd870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6704a95d-0c9b-4ae0-9f5f-b79d6bdcf9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:21 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Volume 694821bb-91e8-4f0e-a60b-f6b86d16365e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694821bb-91e8-4f0e-a60b-f6b86d16365e', 'volume_size': 1} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2057744735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694821bb-91e8-4f0e-a60b-f6b86d16365e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='433aba1f4bb44148a697327d8ab8e3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:22Z,use_quota=True,user_id='487b9d5d03cb45e3958f856ca52fc0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Creating volume 694821bb-91e8-4f0e-a60b-f6b86d16365e {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:21 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:21 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e 1073741824 Sep 09 03:45:21 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:22 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e 1073741824" returned: 0 in 0.610s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:22 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e Sep 09 03:45:22 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:22 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e" returned: 0 in 0.302s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6704a95d-0c9b-4ae0-9f5f-b79d6bdcf9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694821bb-91e8-4f0e-a60b-f6b86d16365e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5011b0f4-73ef-4ae7-8277-55a8f1a40861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:22 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Volume volume-694821bb-91e8-4f0e-a60b-f6b86d16365e (694821bb-91e8-4f0e-a60b-f6b86d16365e): created successfully Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5011b0f4-73ef-4ae7-8277-55a8f1a40861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Flow 'volume_create_manager' (7c8d3898-6f70-496c-8d22-e43d6f88c758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:22 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8d748ee0-fbc0-45b0-b63b-8dd69728d1fd tempest-VolumesTestJSON-661849810 None] Created volume successfully. Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Flow 'volume_create_manager' (6c1f6b05-f579-4abd-a400-df1b6c013d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f08ca79-dba4-4d81-80c9-89e3f1492aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f08ca79-dba4-4d81-80c9-89e3f1492aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-509916186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d766e388-269e-4edc-b3f0-a7ce0db85413,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='433aba1f4bb44148a697327d8ab8e3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:25Z,use_quota=True,user_id='487b9d5d03cb45e3958f856ca52fc0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8feed308-6146-4144-996c-e9f519e76273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8feed308-6146-4144-996c-e9f519e76273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7b24c0-e7ef-4468-ae9c-267c7efd8d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7b24c0-e7ef-4468-ae9c-267c7efd8d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd766e388-269e-4edc-b3f0-a7ce0db85413', 'volume_name': 'volume-d766e388-269e-4edc-b3f0-a7ce0db85413', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e37579-fb0c-427a-8cdf-b4c059c5b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e37579-fb0c-427a-8cdf-b4c059c5b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c3ffcd-f164-45df-86c9-bd35ad3fc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:25 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Volume d766e388-269e-4edc-b3f0-a7ce0db85413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d766e388-269e-4edc-b3f0-a7ce0db85413', 'volume_size': 1} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-509916186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d766e388-269e-4edc-b3f0-a7ce0db85413,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='433aba1f4bb44148a697327d8ab8e3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:25Z,use_quota=True,user_id='487b9d5d03cb45e3958f856ca52fc0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Creating volume d766e388-269e-4edc-b3f0-a7ce0db85413 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:25 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:25 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 1073741824 Sep 09 03:45:25 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:25 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 1073741824" returned: 0 in 0.908s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:26 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 Sep 09 03:45:26 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:26 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413" returned: 0 in 0.344s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c3ffcd-f164-45df-86c9-bd35ad3fc2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d766e388-269e-4edc-b3f0-a7ce0db85413', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac48d2a-10b8-4efb-b03c-4a06c1eb725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:26 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Volume volume-d766e388-269e-4edc-b3f0-a7ce0db85413 (d766e388-269e-4edc-b3f0-a7ce0db85413): created successfully Sep 09 03:45:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac48d2a-10b8-4efb-b03c-4a06c1eb725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Flow 'volume_create_manager' (6c1f6b05-f579-4abd-a400-df1b6c013d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:26 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-93ce8410-fb0d-4220-8363-eb20876ec6e4 tempest-VolumesTestJSON-661849810 None] Created volume successfully. Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Flow 'volume_create_manager' (b86f57c0-4e57-4da1-95ae-09d6769e93c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c00a20-2af2-42f4-9b7a-e05ee5076ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c00a20-2af2-42f4-9b7a-e05ee5076ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-217409713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bff5cdf-9acc-4a24-8613-7837236dfc0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='433aba1f4bb44148a697327d8ab8e3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:28Z,use_quota=True,user_id='487b9d5d03cb45e3958f856ca52fc0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f09b179-3bb9-4b94-91c6-8bea1d6bc1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f09b179-3bb9-4b94-91c6-8bea1d6bc1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae12a357-89f5-4881-ba15-ffd931f49e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae12a357-89f5-4881-ba15-ffd931f49e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bff5cdf-9acc-4a24-8613-7837236dfc0f', 'volume_name': 'volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efd37d9-6315-43c5-a655-1d74133186be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efd37d9-6315-43c5-a655-1d74133186be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30eba97-9ab6-4bde-8fc7-c74e8cb78b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:27 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Volume 2bff5cdf-9acc-4a24-8613-7837236dfc0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f', 'volume_size': 1} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-217409713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bff5cdf-9acc-4a24-8613-7837236dfc0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='433aba1f4bb44148a697327d8ab8e3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:28Z,use_quota=True,user_id='487b9d5d03cb45e3958f856ca52fc0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Creating volume 2bff5cdf-9acc-4a24-8613-7837236dfc0f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:27 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:27 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f 1073741824 Sep 09 03:45:27 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:28 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f 1073741824" returned: 0 in 0.521s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:28 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f Sep 09 03:45:28 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:28 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f" returned: 0 in 0.401s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30eba97-9ab6-4bde-8fc7-c74e8cb78b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebbe042-26b1-4c29-8d54-fab7b8590fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:28 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Volume volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f (2bff5cdf-9acc-4a24-8613-7837236dfc0f): created successfully Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebbe042-26b1-4c29-8d54-fab7b8590fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Flow 'volume_create_manager' (b86f57c0-4e57-4da1-95ae-09d6769e93c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:28 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b3152d86-f4c4-485d-a3c0-a56ab779fa9a tempest-VolumesTestJSON-661849810 None] Created volume successfully. Sep 09 03:45:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Acquiring lock "cinder-2bff5cdf-9acc-4a24-8613-7837236dfc0f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Lock "cinder-2bff5cdf-9acc-4a24-8613-7837236dfc0f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:31 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:INSERT=28,cinder:UPDATE=128,cinder:DELETE=9,cinder:SELECT=101 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:45:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Acquiring lock "cinder-quobyte-2bff5cdf-9acc-4a24-8613-7837236dfc0f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Lock "cinder-quobyte-2bff5cdf-9acc-4a24-8613-7837236dfc0f" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:31 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0377c4f-6201-46f7-a658-75b2732a89d4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:31 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f Sep 09 03:45:31 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:32 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f" returned: 0 in 0.522s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:32 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f Sep 09 03:45:32 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:32 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2bff5cdf-9acc-4a24-8613-7837236dfc0f" returned: 0 in 0.352s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Lock "cinder-quobyte-2bff5cdf-9acc-4a24-8613-7837236dfc0f" released by "delete_volume" :: held 0.949s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Created reservations ['564e63b3-9ca6-4210-8586-87bf5af9a8b4', '1322d24e-8fa3-45f0-94e6-75a83ee6b1fd', '0d6c93e9-b2a1-443b-a503-feb8348c71ed', '3d1c2fd6-d765-4d4a-8f8f-e01f20b267f6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:32 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:45:32 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:33 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.361s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:45:33 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Deleted volume successfully. Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a8fefa83-efb7-463d-8aea-76c78fa147cd tempest-VolumesTestJSON-661849810 None] Lock "cinder-2bff5cdf-9acc-4a24-8613-7837236dfc0f-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Acquiring lock "cinder-d766e388-269e-4edc-b3f0-a7ce0db85413-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Lock "cinder-d766e388-269e-4edc-b3f0-a7ce0db85413-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Acquiring lock "cinder-quobyte-d766e388-269e-4edc-b3f0-a7ce0db85413" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Lock "cinder-quobyte-d766e388-269e-4edc-b3f0-a7ce0db85413" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d473a25-8912-46c0-9b01-fef732ac5155]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:34 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 Sep 09 03:45:34 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Flow 'volume_create_manager' (2486f5bf-dbee-485a-93dd-24c1fd026735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2c9910-2357-417c-8901-986647c2d46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2c9910-2357-417c-8901-986647c2d46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-972245732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27672fc-bdc1-47fd-a37f-d5524f1c5954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddc3ffcdf5948ee948b61d1c8027778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:34Z,use_quota=True,user_id='8c866d2ab20a45db84b8b0f6a57ea721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefde8ed-e713-4f96-864d-ab953359b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefde8ed-e713-4f96-864d-ab953359b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ecd3c9-dd52-4df5-aa78-0ebfeb46a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ecd3c9-dd52-4df5-aa78-0ebfeb46a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27672fc-bdc1-47fd-a37f-d5524f1c5954', 'volume_name': 'volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9d9bce-8c41-42d2-b8d5-62001552bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9d9bce-8c41-42d2-b8d5-62001552bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7449f16-bf83-41e5-87cd-56256be3fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:34 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Volume e27672fc-bdc1-47fd-a37f-d5524f1c5954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954', 'volume_size': 1} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-972245732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27672fc-bdc1-47fd-a37f-d5524f1c5954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddc3ffcdf5948ee948b61d1c8027778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:34Z,use_quota=True,user_id='8c866d2ab20a45db84b8b0f6a57ea721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Creating volume e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:34 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:34 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 1073741824 Sep 09 03:45:34 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:34 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413" returned: 0 in 0.495s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:34 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413 Sep 09 03:45:34 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:34 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d766e388-269e-4edc-b3f0-a7ce0db85413" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Lock "cinder-quobyte-d766e388-269e-4edc-b3f0-a7ce0db85413" released by "delete_volume" :: held 0.906s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Created reservations ['890627bb-9ef4-48d4-8707-79c2f0761c00', '74f97870-a337-444b-a48b-a88f5c3d9a5f', '2fcaecb8-4d42-4601-897d-9fd4ee0491a7', 'ab447a5b-a245-4ab2-923c-f94db50e811c'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:34 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 1073741824" returned: 0 in 0.740s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:35 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 Sep 09 03:45:35 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:35 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:45:35 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:35 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.285s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:45:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Deleted volume successfully. Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c9776e5-c391-4ffb-a077-50bd2eaa0ad7 tempest-VolumesTestJSON-661849810 None] Lock "cinder-d766e388-269e-4edc-b3f0-a7ce0db85413-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:35 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954" returned: 0 in 0.476s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7449f16-bf83-41e5-87cd-56256be3fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fa6fb0-0dde-439b-91a9-b392d70a2a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:35 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Volume volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 (e27672fc-bdc1-47fd-a37f-d5524f1c5954): created successfully Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fa6fb0-0dde-439b-91a9-b392d70a2a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Flow 'volume_create_manager' (2486f5bf-dbee-485a-93dd-24c1fd026735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8ecef28d-5412-4116-a368-4099b33225be tempest-VolumesDeleteCascade-1385232889 None] Created volume successfully. Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Acquiring lock "cinder-694821bb-91e8-4f0e-a60b-f6b86d16365e-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Lock "cinder-694821bb-91e8-4f0e-a60b-f6b86d16365e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Acquiring lock "cinder-quobyte-694821bb-91e8-4f0e-a60b-f6b86d16365e" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Lock "cinder-quobyte-694821bb-91e8-4f0e-a60b-f6b86d16365e" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f07d783-e845-46bb-b00d-23ea3cfa76bb]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:36 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e Sep 09 03:45:36 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Creating offline snapshot 041344b5-fcf0-4d27-9305-a04e4f130e9d of volume e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c2ea3-ea9c-468e-bd22-7cb645bbb438]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:36 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e" returned: 0 in 0.570s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:36 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e Sep 09 03:45:36 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:36 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 Sep 09 03:45:36 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:37 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-694821bb-91e8-4f0e-a60b-f6b86d16365e" returned: 0 in 0.303s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Lock "cinder-quobyte-694821bb-91e8-4f0e-a60b-f6b86d16365e" released by "delete_volume" :: held 0.942s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Created reservations ['3d3b325d-c36d-4533-995e-afc19492611e', 'a1ef5c7e-5405-401d-9ee1-71bc498584f3', '38ea6503-f293-45fa-babb-1ced2fc49fc8', '403f5b2e-ab45-4673-8ac4-d14fc9ff4533'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:37 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:37 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:45:37 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954" returned: 0 in 0.661s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:37 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:45:37 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:37 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d 1G Sep 09 03:45:37 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:37 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.429s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:45:37 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.555s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:45:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Deleted volume successfully. Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-221ae3d4-3155-4861-b227-dabfabf29edc tempest-VolumesTestJSON-661849810 None] Lock "cinder-694821bb-91e8-4f0e-a60b-f6b86d16365e-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:37 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d 1G" returned: 0 in 0.592s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:37 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d Sep 09 03:45:37 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:38 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d" returned: 0 in 0.341s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:38 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d is being set with open permissions: ugo+rw Sep 09 03:45:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:38 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d Sep 09 03:45:38 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:38 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d" returned: 0 in 0.281s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:38 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=147,cinder:SELECT=117,cinder:DELETE=10,cinder:INSERT=38 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:45:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:38 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.info Sep 09 03:45:38 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:38 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.info" returned: 0 in 0.297s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:38 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.info is being set with open permissions: ugo+rw Sep 09 03:45:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:38 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.info Sep 09 03:45:38 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:39 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.info" returned: 0 in 0.291s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c16871d9-4c56-4cdf-b266-155e711d13ce tempest-VolumesDeleteCascade-1385232889 None] Create snapshot completed successfully Sep 09 03:45:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Creating offline snapshot 270ad653-b92e-4641-b84c-8deb1dcc71b6 of volume e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:45:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ae6f80-1b41-4bf2-b9c5-7cf9e26be52e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:40 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d Sep 09 03:45:40 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:40 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d" returned: 0 in 0.441s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:45:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:40 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 1G Sep 09 03:45:40 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:41 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 1G" returned: 0 in 0.512s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:41 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 Sep 09 03:45:41 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:41 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6" returned: 0 in 0.343s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:41 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 is being set with open permissions: ugo+rw Sep 09 03:45:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:41 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 Sep 09 03:45:41 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:41 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6" returned: 0 in 0.305s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.712s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0bfe0fe8-4d91-418c-84fa-702f3601acdc tempest-VolumesDeleteCascade-1385232889 None] Create snapshot completed successfully Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-e27672fc-bdc1-47fd-a37f-d5524f1c5954-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-e27672fc-bdc1-47fd-a37f-d5524f1c5954-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Performing cascade delete. {{(pid=87597) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-041344b5-fcf0-4d27-9305-a04e4f130e9d-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-041344b5-fcf0-4d27-9305-a04e4f130e9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-041344b5-fcf0-4d27-9305-a04e4f130e9d" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-041344b5-fcf0-4d27-9305-a04e4f130e9d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Deleting offline snapshot 041344b5-fcf0-4d27-9305-a04e4f130e9d of volume e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] snapshot_file for this snap is: volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3406c666-edcb-4611-b66e-32549e12e170]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:42 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d Sep 09 03:45:42 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:42 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d" returned: 0 in 0.445s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c458f028-669d-4623-9be1-d640442974e4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:43 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 Sep 09 03:45:43 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:43 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954" returned: 0 in 0.479s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:43 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d316d2ea-75f3-4118-ba7b-540860e31a96]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:43 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 Sep 09 03:45:43 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:43 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6" returned: 0 in 0.391s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:45:43 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d84fb7-8187-46ca-8edc-f71f46013272]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:43 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d Sep 09 03:45:43 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:44 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d" returned: 0 in 0.566s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:45:44 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f17625-9c6c-4808-a8d6-4d4bbdc67614]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:44 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 Sep 09 03:45:44 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:44 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954" returned: 0 in 0.493s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:45 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d Sep 09 03:45:45 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d" returned: 0 in 0.538s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:45 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:45 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d Sep 09 03:45:45 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:45 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.041344b5-fcf0-4d27-9305-a04e4f130e9d" returned: 0 in 0.458s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 -F qcow2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:46 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 -F qcow2 Sep 09 03:45:46 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:46 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 -F qcow2" returned: 0 in 0.434s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-041344b5-fcf0-4d27-9305-a04e4f130e9d" released by "_delete_snapshot" :: held 4.073s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" released by "delete_snapshot" :: held 4.105s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Created reservations ['59aee294-ea0f-455a-87e7-a61b9a489927', 'bbd6e042-64c7-4287-8b95-97fe640fcb81', '7e5045e8-cb48-4b6e-b4d0-a47e89c7cafc', 'e674ab77-8a65-4389-8fb2-e914f430e154'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Delete snapshot completed successfully. Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-041344b5-fcf0-4d27-9305-a04e4f130e9d-delete_snapshot" released by "delete_snapshot" :: held 4.396s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-270ad653-b92e-4641-b84c-8deb1dcc71b6-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-270ad653-b92e-4641-b84c-8deb1dcc71b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-270ad653-b92e-4641-b84c-8deb1dcc71b6" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-270ad653-b92e-4641-b84c-8deb1dcc71b6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Deleting offline snapshot 270ad653-b92e-4641-b84c-8deb1dcc71b6 of volume e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] snapshot_file for this snap is: volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef72de-41af-4f6a-bf1a-faabb87fd593]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:47 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 Sep 09 03:45:47 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:47 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6" returned: 0 in 0.585s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:45:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a719e8-c9bc-4b5c-a927-7b1ab3e9ef52]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f62ef152-8728-4793-a51c-3d6ed6cf5204 tempest-BackendsCapabilitiesAdminTestsJSON-768433519 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4433860778809, 'free_capacity_gb': 1773.4433860778809, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87597) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 03:45:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-15cecfc2-ff74-49ab-afa3-6f2eee501702 tempest-BackendsCapabilitiesAdminTestsJSON-768433519 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4433860778809, 'free_capacity_gb': 1773.4433860778809, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87597) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 03:45:47 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 Sep 09 03:45:47 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:48 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954" returned: 0 in 0.504s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:48 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 Sep 09 03:45:48 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:48 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6" returned: 0 in 0.628s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:48 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6 Sep 09 03:45:48 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Flow 'volume_create_manager' (dbfe3db8-6494-4933-9dee-85a105f8f4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3f859a-8837-4a8a-8846-5c2d5ba1959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3f859a-8837-4a8a-8846-5c2d5ba1959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1981060055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed25120-77d4-4510-b6df-22a23ce76f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6482c52bd18c4b7a8bc9163325cf4213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:49Z,use_quota=True,user_id='b5463dcbf313482ca9f29a3f1c276d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d8067b-416b-451e-b187-b4ce948d31d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d8067b-416b-451e-b187-b4ce948d31d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6e88ff-f103-4c2c-a5b1-ae1523a2dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6e88ff-f103-4c2c-a5b1-ae1523a2dff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed25120-77d4-4510-b6df-22a23ce76f26', 'volume_name': 'volume-4ed25120-77d4-4510-b6df-22a23ce76f26', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394d810e-c943-4f5f-bb0f-f84ff864e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394d810e-c943-4f5f-bb0f-f84ff864e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea90f8d7-fc75-4f64-9997-67dae6f5e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:48 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Volume 4ed25120-77d4-4510-b6df-22a23ce76f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed25120-77d4-4510-b6df-22a23ce76f26', 'volume_size': 1} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1981060055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed25120-77d4-4510-b6df-22a23ce76f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6482c52bd18c4b7a8bc9163325cf4213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:49Z,use_quota=True,user_id='b5463dcbf313482ca9f29a3f1c276d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Creating volume 4ed25120-77d4-4510-b6df-22a23ce76f26 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:48 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:49 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 1073741824 Sep 09 03:45:49 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:49 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954.270ad653-b92e-4641-b84c-8deb1dcc71b6" returned: 0 in 0.382s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-270ad653-b92e-4641-b84c-8deb1dcc71b6" released by "_delete_snapshot" :: held 2.274s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" released by "delete_snapshot" :: held 2.309s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Created reservations ['12e4074b-7a80-4984-970a-31c641e16eb9', 'c1ca48b6-d924-4d26-af73-caa5bb444a2d', '65725eae-fd83-400f-8340-280e97065d28', '882e1650-a808-430e-a10f-6417f89b8a04'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Delete snapshot completed successfully. Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-270ad653-b92e-4641-b84c-8deb1dcc71b6-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Snapshots deleted, issuing volume delete {{(pid=87597) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4124c8e2-6a5f-4236-bfe1-66b9acb8c7e9]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:49 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 Sep 09 03:45:49 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:49 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 1073741824" returned: 0 in 0.589s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:49 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 Sep 09 03:45:49 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:49 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954" returned: 0 in 0.578s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:50 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954 Sep 09 03:45:50 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:50 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26" returned: 0 in 0.442s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea90f8d7-fc75-4f64-9997-67dae6f5e255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed25120-77d4-4510-b6df-22a23ce76f26', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065626ca-ffbc-40d0-b27c-5b88255ef1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:50 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Volume volume-4ed25120-77d4-4510-b6df-22a23ce76f26 (4ed25120-77d4-4510-b6df-22a23ce76f26): created successfully Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065626ca-ffbc-40d0-b27c-5b88255ef1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Flow 'volume_create_manager' (dbfe3db8-6494-4933-9dee-85a105f8f4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:50 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-de6916d6-aa3b-4abd-8323-e128bfe0a9a7 tempest-AttachVolumeShelveTestJSON-1895824303 None] Created volume successfully. Sep 09 03:45:50 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e27672fc-bdc1-47fd-a37f-d5524f1c5954" returned: 0 in 0.357s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-e27672fc-bdc1-47fd-a37f-d5524f1c5954" released by "delete_volume" :: held 1.024s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Created reservations ['97d96139-5f8c-4105-a4f7-39e787f40405', '0e5dca23-a38c-47fe-9ab1-8eb542db1739', '02543e7a-bd2d-4aa8-b687-a094758147c2', '7dcfabe8-b94b-48ac-902f-30f9373127c3'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:50 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:45:50 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:50 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:45:50 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Deleted volume successfully. Sep 09 03:45:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6f037cf-eb37-4a60-b8ac-c7c41dea4aba tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-e27672fc-bdc1-47fd-a37f-d5524f1c5954-delete_volume" released by "delete_volume" :: held 8.631s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Flow 'volume_create_manager' (5fdeada9-05b9-4868-85e9-deb2f64bc519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa8f1ad-19fd-4f0b-ad85-458d713052bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa8f1ad-19fd-4f0b-ad85-458d713052bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1427163997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa590a53-4da5-4a47-b5dc-3e13d2d89c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddc3ffcdf5948ee948b61d1c8027778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:52Z,use_quota=True,user_id='8c866d2ab20a45db84b8b0f6a57ea721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad0d4f6-43cc-4926-b2bd-f355a7b7126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad0d4f6-43cc-4926-b2bd-f355a7b7126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9eb82e-9b59-41e7-b356-faed4cda328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9eb82e-9b59-41e7-b356-faed4cda328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa590a53-4da5-4a47-b5dc-3e13d2d89c6d', 'volume_name': 'volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498a6672-6a99-472c-a181-0ec77f9100b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498a6672-6a99-472c-a181-0ec77f9100b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cc6c60-d02d-4a76-9b0c-706a2a2a1912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:52 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Volume aa590a53-4da5-4a47-b5dc-3e13d2d89c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d', 'volume_size': 1} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1427163997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa590a53-4da5-4a47-b5dc-3e13d2d89c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddc3ffcdf5948ee948b61d1c8027778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:52Z,use_quota=True,user_id='8c866d2ab20a45db84b8b0f6a57ea721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Creating volume aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:52 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:52 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d 1073741824 Sep 09 03:45:52 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:53 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d 1073741824" returned: 0 in 0.616s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:53 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d Sep 09 03:45:53 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:53 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" returned: 0 in 0.316s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cc6c60-d02d-4a76-9b0c-706a2a2a1912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d28b355-d58a-440c-8b3b-749c6a77224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:53 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Volume volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d (aa590a53-4da5-4a47-b5dc-3e13d2d89c6d): created successfully Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d28b355-d58a-440c-8b3b-749c6a77224f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Flow 'volume_create_manager' (5fdeada9-05b9-4868-85e9-deb2f64bc519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:53 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e70d1977-1ce7-4e9b-9ca5-c27fb6e4b822 tempest-VolumesDeleteCascade-1385232889 None] Created volume successfully. Sep 09 03:45:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Creating offline snapshot b5e78a66-9d93-4b42-b624-ba135a58f7ff of volume aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:45:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[098fb52c-d069-4485-8705-000b4c3a1f21]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:54 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d Sep 09 03:45:54 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:55 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" returned: 0 in 0.450s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:55 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff 1G Sep 09 03:45:55 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:55 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff 1G" returned: 0 in 0.576s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:55 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff Sep 09 03:45:55 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8fc0d470-a2ee-44b5-81df-91f9aa7df1ad tempest-GroupSnapshotsTest-1175724365 None] Group tempest-GroupSnapshotsTest-Group-1550368836: creating Sep 09 03:45:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8fc0d470-a2ee-44b5-81df-91f9aa7df1ad tempest-GroupSnapshotsTest-1175724365 None] Group tempest-GroupSnapshotsTest-Group-1550368836: created successfully Sep 09 03:45:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8fc0d470-a2ee-44b5-81df-91f9aa7df1ad tempest-GroupSnapshotsTest-1175724365 None] Create group completed successfully. Sep 09 03:45:56 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff" returned: 0 in 0.421s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:56 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff is being set with open permissions: ugo+rw Sep 09 03:45:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:56 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff Sep 09 03:45:56 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:56 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff" returned: 0 in 0.262s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:56 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.info Sep 09 03:45:56 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:56 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.info" returned: 0 in 0.320s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:56 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.info is being set with open permissions: ugo+rw Sep 09 03:45:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:56 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.info Sep 09 03:45:56 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:57 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.info" returned: 0 in 0.466s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d04d4aef-b003-43e0-9533-8852bb5e9a55 tempest-VolumesDeleteCascade-1385232889 None] Create snapshot completed successfully Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Flow 'volume_create_manager' (06e7e03f-da4a-4a55-be89-48e0f731bb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd3f323-cd5d-41bb-bae8-efcd88573ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd3f323-cd5d-41bb-bae8-efcd88573ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117617759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9dac94f7-2811-4ae0-9e23-498a3b5f483e,host='devstack@QuobyteHD#QuobyteHD',id=3771f0bc-ba9b-4fd3-a76a-70f5768caf80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a222cbd362480a905e4927ffe680be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:58Z,use_quota=True,user_id='94173180af28483b9f09b2e06ca6e4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eccac2f-1b8f-436f-9e2a-3b95bbb91558),volume_type_id=6eccac2f-1b8f-436f-9e2a-3b95bbb91558)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f1f095-0566-4540-a213-0163eed17d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f1f095-0566-4540-a213-0163eed17d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbd9220-89c3-4003-897d-2d8a6bd8d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbd9220-89c3-4003-897d-2d8a6bd8d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3771f0bc-ba9b-4fd3-a76a-70f5768caf80', 'volume_name': 'volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9e939f-4c40-4fc7-ab3d-905c6dfedf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9e939f-4c40-4fc7-ab3d-905c6dfedf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637a7287-6c6f-4b99-abdf-6a39f4c71b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Volume 3771f0bc-ba9b-4fd3-a76a-70f5768caf80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80', 'volume_size': 1} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9dac94f7-2811-4ae0-9e23-498a3b5f483e,created_at=2026-09-09T01:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117617759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9dac94f7-2811-4ae0-9e23-498a3b5f483e,host='devstack@QuobyteHD#QuobyteHD',id=3771f0bc-ba9b-4fd3-a76a-70f5768caf80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a222cbd362480a905e4927ffe680be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:58Z,use_quota=True,user_id='94173180af28483b9f09b2e06ca6e4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eccac2f-1b8f-436f-9e2a-3b95bbb91558),volume_type_id=6eccac2f-1b8f-436f-9e2a-3b95bbb91558)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Creating volume 3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:58 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:58 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 1073741824 Sep 09 03:45:58 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Flow 'volume_create_manager' (f1420d07-76aa-4422-8784-086ee1063ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046650ec-6906-4dec-8965-b931123fd214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046650ec-6906-4dec-8965-b931123fd214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1437230395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25de4d86-c1d1-4701-9d1f-a64aa41b730d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fddc3ffcdf5948ee948b61d1c8027778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5e78a66-9d93-4b42-b624-ba135a58f7ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:45:59Z,use_quota=True,user_id='8c866d2ab20a45db84b8b0f6a57ea721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:58 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab7334-c3e1-4f46-b1fc-c463644ec4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab7334-c3e1-4f46-b1fc-c463644ec4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f57fe7e-41d0-472a-9fd6-9358b5238168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f57fe7e-41d0-472a-9fd6-9358b5238168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25de4d86-c1d1-4701-9d1f-a64aa41b730d', 'volume_name': 'volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d', 'volume_size': 1, 'snapshot_id': 'b5e78a66-9d93-4b42-b624-ba135a58f7ff'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4030f0ff-e54a-4b92-b7e5-96b4f815e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4030f0ff-e54a-4b92-b7e5-96b4f815e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ff8be1-7c48-4a7c-a7c5-40d6164655b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:59 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Volume 25de4d86-c1d1-4701-9d1f-a64aa41b730d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d', 'volume_size': 1, 'snapshot_id': 'b5e78a66-9d93-4b42-b624-ba135a58f7ff'} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 1073741824" returned: 0 in 0.756s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:59 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 Sep 09 03:45:59 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:45:59 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" returned: 0 in 0.304s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.343s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-b5e78a66-9d93-4b42-b624-ba135a58f7ff-25de4d86-c1d1-4701-9d1f-a64aa41b730d" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637a7287-6c6f-4b99-abdf-6a39f4c71b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8b18e2-9c11-49d5-a2f3-97926519840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-b5e78a66-9d93-4b42-b624-ba135a58f7ff-25de4d86-c1d1-4701-9d1f-a64aa41b730d" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Creating volume 25de4d86-c1d1-4701-9d1f-a64aa41b730d from snapshot b5e78a66-9d93-4b42-b624-ba135a58f7ff {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-25de4d86-c1d1-4701-9d1f-a64aa41b730d" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:45:59 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Volume volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 (3771f0bc-ba9b-4fd3-a76a-70f5768caf80): created successfully Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8b18e2-9c11-49d5-a2f3-97926519840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Flow 'volume_create_manager' (06e7e03f-da4a-4a55-be89-48e0f731bb32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:45:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-52bead6b-9659-4b0d-9a05-58418a86c41a tempest-GroupSnapshotsTest-1175724365 None] Created volume successfully. Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-25de4d86-c1d1-4701-9d1f-a64aa41b730d" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] snapshot: b5e78a66-9d93-4b42-b624-ba135a58f7ff, volume: 25de4d86-c1d1-4701-9d1f-a64aa41b730d, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[52544654-6def-4c6d-aca5-94b372e35687]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:45:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:45:59 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff Sep 09 03:45:59 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:00 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff" returned: 0 in 0.470s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c307489f-596c-48b8-a9e0-0775cd6fe5fe]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:00 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d Sep 09 03:46:00 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:00 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" returned: 0 in 0.428s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:46:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:00 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d Sep 09 03:46:00 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:00 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] GroupSnapshot adccd8fd-5a54-411c-aded-e2f3a0642773: creating. Sep 09 03:46:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Group snapshot adccd8fd-5a54-411c-aded-e2f3a0642773: creating. {{(pid=87597) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 03:46:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-20dcfdf5-de00-46ee-a3f5-5c54ee1000dc req-8de5520e-92f5-45af-a2a3-8e58c51ceb25 tempest-AttachVolumeShelveTestJSON-1895824303 None] No connector for attachment ca2bfd81-eae9-42bf-aa6e-dd21aa342ba2; skipping storage backend terminate_connection call. {{(pid=87597) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 09 03:46:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-20dcfdf5-de00-46ee-a3f5-5c54ee1000dc req-8de5520e-92f5-45af-a2a3-8e58c51ceb25 tempest-AttachVolumeShelveTestJSON-1895824303 None] Deleting attachment ca2bfd81-eae9-42bf-aa6e-dd21aa342ba2. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:46:06 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d" returned: 0 in 6.239s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:06 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:46:06 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Converted 1024.00 MB image at 164.10 MB/s Sep 09 03:46:06 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d is being set with open permissions: ugo+rw Sep 09 03:46:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:06 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d Sep 09 03:46:06 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:07 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d" returned: 0 in 0.322s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-25de4d86-c1d1-4701-9d1f-a64aa41b730d" released by "_copy_volume_from_snapshot" :: held 7.561s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-b5e78a66-9d93-4b42-b624-ba135a58f7ff-25de4d86-c1d1-4701-9d1f-a64aa41b730d" released by "_create_volume_from_snapshot" :: held 7.687s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.728s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.077s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Creating offline snapshot 8fea12ff-6bae-4b04-95fc-a91c8cf3f121 of volume 3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ff8be1-7c48-4a7c-a7c5-40d6164655b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d', 'volume_size': 1, 'snapshot_id': 'b5e78a66-9d93-4b42-b624-ba135a58f7ff'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411c5972-e5fe-4e39-8eea-c042cf0954fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b38c5e-c472-4f79-afcd-9cd2fba459bb]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:07 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Volume volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d (25de4d86-c1d1-4701-9d1f-a64aa41b730d): created successfully Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411c5972-e5fe-4e39-8eea-c042cf0954fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Flow 'volume_create_manager' (f1420d07-76aa-4422-8784-086ee1063ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b555bfaf-967c-44a5-b5af-2d701d6f2b48 tempest-VolumesDeleteCascade-1385232889 None] Created volume successfully. Sep 09 03:46:07 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 Sep 09 03:46:07 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:07 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" returned: 0 in 0.467s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:07 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 1G Sep 09 03:46:07 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:08 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 1G" returned: 0 in 0.573s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Performing cascade delete. {{(pid=87597) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-b5e78a66-9d93-4b42-b624-ba135a58f7ff-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:08 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 Sep 09 03:46:08 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-b5e78a66-9d93-4b42-b624-ba135a58f7ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-b5e78a66-9d93-4b42-b624-ba135a58f7ff" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-b5e78a66-9d93-4b42-b624-ba135a58f7ff" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Deleting offline snapshot b5e78a66-9d93-4b42-b624-ba135a58f7ff of volume aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] snapshot_file for this snap is: volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c6b0c-9d5b-4668-b642-ac8c6ddecc29]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:08 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff Sep 09 03:46:08 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:08 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121" returned: 0 in 0.469s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:08 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:08 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 Sep 09 03:46:08 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:08 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff" returned: 0 in 0.501s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e96a53f-48d5-4461-aa7e-1e1ef8e54c42]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:09 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121" returned: 0 in 0.299s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:09 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d Sep 09 03:46:09 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:09 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.info Sep 09 03:46:09 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:09 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.info" returned: 0 in 0.360s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:09 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:46:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:09 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.info Sep 09 03:46:09 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:09 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" returned: 0 in 0.618s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:09 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff Sep 09 03:46:09 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:09 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.info" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-038b7153-3fe1-4da9-84fd-6d9249ba0c22 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot adccd8fd-5a54-411c-aded-e2f3a0642773: created successfully Sep 09 03:46:10 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff" returned: 0 in 0.626s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:10 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff Sep 09 03:46:10 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:10 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d.b5e78a66-9d93-4b42-b624-ba135a58f7ff" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-b5e78a66-9d93-4b42-b624-ba135a58f7ff" released by "_delete_snapshot" :: held 2.218s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" released by "delete_snapshot" :: held 2.264s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Created reservations ['e1ef2fa7-83ea-4e24-a189-50b4735aa125', '2ef7a2a5-837d-4c74-9a05-5772718ab06b', 'c11200d4-fc36-47a7-8c0f-8b96be72d034', '355dc41c-3c46-4980-a532-a445014879de'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Delete snapshot completed successfully. Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-b5e78a66-9d93-4b42-b624-ba135a58f7ff-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Snapshots deleted, issuing volume delete {{(pid=87597) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" acquired by "delete_volume" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:10 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c447c362-70f5-48b3-a757-b6d5c8f1335e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:11 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d Sep 09 03:46:11 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:11 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" returned: 0 in 0.471s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:11 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d Sep 09 03:46:11 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:11 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-8fea12ff-6bae-4b04-95fc-a91c8cf3f121-b134c755-ea75-43e0-a6ea-c09767473cb4" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" returned: 0 in 0.360s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d" released by "delete_volume" :: held 0.971s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-8fea12ff-6bae-4b04-95fc-a91c8cf3f121-b134c755-ea75-43e0-a6ea-c09767473cb4" acquired by "_create_volume_from_snapshot" :: waited 0.063s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Creating volume b134c755-ea75-43e0-a6ea-c09767473cb4 from snapshot 8fea12ff-6bae-4b04-95fc-a91c8cf3f121 {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-b134c755-ea75-43e0-a6ea-c09767473cb4" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-b134c755-ea75-43e0-a6ea-c09767473cb4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] snapshot: 8fea12ff-6bae-4b04-95fc-a91c8cf3f121, volume: b134c755-ea75-43e0-a6ea-c09767473cb4, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c84d7a-6171-4606-b6fd-bcabcf601dfb]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Created reservations ['d80226f2-da32-4b44-8970-97f02e32c2c2', 'a07708f7-8ea7-4042-b21a-3c9ed6a87725', 'fa9b6217-0ba1-464e-a1ff-1a550c25c897', '843e1e4e-a208-4067-a678-48cb4ccc7ae7'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:12 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 Sep 09 03:46:12 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:12 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:12 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:12 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121" returned: 0 in 0.490s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01856a5-115b-44f1-928f-e46af3bd3214]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:12 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.389s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Deleted volume successfully. Sep 09 03:46:12 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 Sep 09 03:46:12 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce12dbb6-7b9a-46db-adda-cd64d36cf44d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-aa590a53-4da5-4a47-b5dc-3e13d2d89c6d-delete_volume" released by "delete_volume" :: held 4.645s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-25de4d86-c1d1-4701-9d1f-a64aa41b730d-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-25de4d86-c1d1-4701-9d1f-a64aa41b730d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:13 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "cinder-quobyte-25de4d86-c1d1-4701-9d1f-a64aa41b730d" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" returned: 0 in 0.658s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-25de4d86-c1d1-4701-9d1f-a64aa41b730d" acquired by "delete_volume" :: waited 0.062s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:13 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 Sep 09 03:46:13 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[432b4b1b-0d71-4a15-b677-8c6c7e197938]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:13 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d Sep 09 03:46:13 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:13 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d" returned: 0 in 0.666s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:14 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d Sep 09 03:46:14 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:14 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-25de4d86-c1d1-4701-9d1f-a64aa41b730d" returned: 0 in 0.970s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-quobyte-25de4d86-c1d1-4701-9d1f-a64aa41b730d" released by "delete_volume" :: held 1.766s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:15 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Created reservations ['f82bf9f1-ee6b-46f8-a103-a46d17da0b98', '8063a7bf-a6cf-4330-adcb-9831e07da8fb', 'c8741b05-d5bb-4a04-9fc4-0270a99fc669', 'f654d763-e905-4aef-8438-9a6b91887ebb'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:15 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:15 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:16 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 1.178s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:16 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Deleted volume successfully. Sep 09 03:46:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b2b2ae37-4903-4f01-8a96-f8c165660b6d tempest-VolumesDeleteCascade-1385232889 None] Lock "cinder-25de4d86-c1d1-4701-9d1f-a64aa41b730d-delete_volume" released by "delete_volume" :: held 3.962s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:21 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4" returned: 0 in 8.280s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:21 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:46:21 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Converted 1024.00 MB image at 123.66 MB/s Sep 09 03:46:21 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:46:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:21 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 Sep 09 03:46:21 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:21 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4" returned: 0 in 0.370s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-b134c755-ea75-43e0-a6ea-c09767473cb4" released by "_copy_volume_from_snapshot" :: held 9.966s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-8fea12ff-6bae-4b04-95fc-a91c8cf3f121-b134c755-ea75-43e0-a6ea-c09767473cb4" released by "_create_volume_from_snapshot" :: held 10.100s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.168s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:22 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cbf593c3-84ad-49d5-994b-1c23b788d37a tempest-GroupSnapshotsTest-1175724365 None] Create group from source-snapshot-adccd8fd-5a54-411c-aded-e2f3a0642773 completed successfully. Sep 09 03:46:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-b134c755-ea75-43e0-a6ea-c09767473cb4" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-b134c755-ea75-43e0-a6ea-c09767473cb4" acquired by "delete_volume" :: waited 0.044s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:23 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f58325f-2c66-4a27-95e6-d7f4b8b1523e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:23 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 Sep 09 03:46:23 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:24 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4" returned: 0 in 1.000s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:24 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4 Sep 09 03:46:24 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:24 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b134c755-ea75-43e0-a6ea-c09767473cb4" returned: 0 in 0.475s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-b134c755-ea75-43e0-a6ea-c09767473cb4" released by "delete_volume" :: held 1.624s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:24 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['67616bf9-c43e-4363-b08a-5405772ef219'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:25 devstack cinder-volume[87597]: WARNING cinder.quota [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-510640938 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-510640938, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:46:25 devstack cinder-volume[87597]: WARNING cinder.quota [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-510640938 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-510640938, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['d5206e89-2e1f-4c85-bdd3-0ab0fe09cb0f', 'b8652316-54b1-4103-a178-e115fcd2e524', 'b9ad2562-6129-4796-9e11-f6bb54a5c933', '5ffbf2f0-f1c1-4257-98ff-413cc3e7d336'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (82ab3425-a777-4ba8-a68b-116c6b0ffda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5222e51f-8244-4ff4-859f-a1eca0711ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5222e51f-8244-4ff4-859f-a1eca0711ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1640220027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b06c22-f286-4233-b408-6eb4a31d5240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:25Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0851e634-0360-4247-a7e2-e5bae8d6f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0851e634-0360-4247-a7e2-e5bae8d6f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cff67ef-6755-44e2-9b64-314eb30f7e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cff67ef-6755-44e2-9b64-314eb30f7e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b06c22-f286-4233-b408-6eb4a31d5240', 'volume_name': 'volume-e9b06c22-f286-4233-b408-6eb4a31d5240', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3707dbc-b3ca-4862-aa8c-577d276a5a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3707dbc-b3ca-4862-aa8c-577d276a5a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913e60b2-8472-49a5-8e0d-1af6f70d5604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:25 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Volume e9b06c22-f286-4233-b408-6eb4a31d5240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b06c22-f286-4233-b408-6eb4a31d5240', 'volume_size': 1} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1640220027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b06c22-f286-4233-b408-6eb4a31d5240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:25Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Creating volume e9b06c22-f286-4233-b408-6eb4a31d5240 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:25 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:25 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 1073741824 Sep 09 03:46:25 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:25 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:25 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:26 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot adccd8fd-5a54-411c-aded-e2f3a0642773: deleting Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot adccd8fd-5a54-411c-aded-e2f3a0642773: deleting {{(pid=87597) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:26 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.619s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-8fea12ff-6bae-4b04-95fc-a91c8cf3f121" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:26 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f05e58c0-9367-40a4-90b7-057f41c90c25 tempest-GroupSnapshotsTest-1175724365 None] Delete group completed successfully. Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-8fea12ff-6bae-4b04-95fc-a91c8cf3f121" acquired by "_delete_snapshot" :: waited 0.086s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Deleting offline snapshot 8fea12ff-6bae-4b04-95fc-a91c8cf3f121 of volume 3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] snapshot_file for this snap is: volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f185f-185a-4caa-9472-26bd7d57ac52]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:26 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 1073741824" returned: 0 in 1.103s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:27 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 Sep 09 03:46:27 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:27 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 Sep 09 03:46:27 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:27 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240" returned: 0 in 0.822s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913e60b2-8472-49a5-8e0d-1af6f70d5604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b06c22-f286-4233-b408-6eb4a31d5240', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be620d11-9053-46c2-a955-47c67f982a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:27 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Volume volume-e9b06c22-f286-4233-b408-6eb4a31d5240 (e9b06c22-f286-4233-b408-6eb4a31d5240): created successfully Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be620d11-9053-46c2-a955-47c67f982a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (82ab3425-a777-4ba8-a68b-116c6b0ffda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:27 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-51eb46b7-aea8-41ac-a3f8-4b73ed99b5ca tempest-VolumesActionsTest-712279661 None] Created volume successfully. Sep 09 03:46:27 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121" returned: 0 in 1.250s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f87ab2-2b8c-4c7f-8533-ceb143bd51b6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:28 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 Sep 09 03:46:28 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:28 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-064510dd-4272-467f-a266-72a4c966a27b tempest-VolumesActionsTest-712279661 None] Acquiring lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240" by "attach_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:28 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-064510dd-4272-467f-a266-72a4c966a27b tempest-VolumesActionsTest-712279661 None] Lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240" acquired by "attach_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:28 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" returned: 0 in 0.815s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:28 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-064510dd-4272-467f-a266-72a4c966a27b tempest-VolumesActionsTest-712279661 None] Attaching volume e9b06c22-f286-4233-b408-6eb4a31d5240 to instance 46bdefa5-bd26-40d2-84e7-753a1312f3a7 at mountpoint /dev/vdb on host None. Sep 09 03:46:28 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 Sep 09 03:46:28 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:28 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-064510dd-4272-467f-a266-72a4c966a27b tempest-VolumesActionsTest-712279661 None] Attach volume completed successfully. Sep 09 03:46:28 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-064510dd-4272-467f-a266-72a4c966a27b tempest-VolumesActionsTest-712279661 None] Lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240" released by "attach_volume" :: held 0.232s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:29 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121" returned: 0 in 0.743s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:29 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121 Sep 09 03:46:29 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:29 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ae9eca1f-9ac2-4311-a4c5-f0870c78b5ed tempest-VolumesActionsTest-1543023399 None] Terminate volume connection completed successfully. Sep 09 03:46:29 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae9eca1f-9ac2-4311-a4c5-f0870c78b5ed tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-detach_volume" by "detach_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae9eca1f-9ac2-4311-a4c5-f0870c78b5ed tempest-VolumesActionsTest-1543023399 None] Lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:30 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80.8fea12ff-6bae-4b04-95fc-a91c8cf3f121" returned: 0 in 0.557s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:30 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ae9eca1f-9ac2-4311-a4c5-f0870c78b5ed tempest-VolumesActionsTest-1543023399 None] Detaching volume e9b06c22-f286-4233-b408-6eb4a31d5240 from instance 46bdefa5-bd26-40d2-84e7-753a1312f3a7. Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-8fea12ff-6bae-4b04-95fc-a91c8cf3f121" released by "_delete_snapshot" :: held 3.544s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" released by "delete_snapshot" :: held 3.672s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:30 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ae9eca1f-9ac2-4311-a4c5-f0870c78b5ed tempest-VolumesActionsTest-1543023399 None] Detach volume completed successfully. Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae9eca1f-9ac2-4311-a4c5-f0870c78b5ed tempest-VolumesActionsTest-1543023399 None] Lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-detach_volume" released by "detach_volume" :: held 0.272s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:30 devstack cinder-volume[87597]: WARNING cinder.quota [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-510640938 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-510640938, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['e3d40a6b-06d8-4ba9-b22c-bd8309319670', 'd77b95a5-ceff-4837-9db5-f225ba48f054', '87ed9a76-5e6f-4d3f-8f83-b35aafbd4fd9', 'ddcba2a0-6ead-4d51-a90b-efcefa0ba0ad'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:30 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0f1e01fb-5ca3-45a3-a0e1-a5c2a0e808a8 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot adccd8fd-5a54-411c-aded-e2f3a0642773: deleted successfully Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c3406651-0cee-4e2b-8093-b17d78d83651 tempest-VolumesActionsTest-712279661 None] Acquiring lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-detach_volume" by "detach_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c3406651-0cee-4e2b-8093-b17d78d83651 tempest-VolumesActionsTest-712279661 None] Lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:30 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c3406651-0cee-4e2b-8093-b17d78d83651 tempest-VolumesActionsTest-712279661 None] Volume detach called, but volume not attached. Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c3406651-0cee-4e2b-8093-b17d78d83651 tempest-VolumesActionsTest-712279661 None] Lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Acquiring lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Acquiring lock "cinder-quobyte-e9b06c22-f286-4233-b408-6eb4a31d5240" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Lock "cinder-quobyte-e9b06c22-f286-4233-b408-6eb4a31d5240" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1e71f8-fe78-4e0c-8f9c-3fee1c4a8f9c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:31 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 Sep 09 03:46:31 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=108,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=8 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Flow 'volume_create_manager' (46d7c020-532c-4891-92c1-d300768f9b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9356f4-028e-4481-88ff-563c81af61d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9356f4-028e-4481-88ff-563c81af61d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-680988120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18347510-8822-42a8-b39d-4c387d65e41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d7cb9ebc345b3a1eba793f61793f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:31Z,use_quota=True,user_id='f69a55be72414c68ab7eb78b46ee1e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:31 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f09938-e047-4339-879a-f2eef5a5c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f09938-e047-4339-879a-f2eef5a5c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af5c72d-b0e9-4a2e-a14f-60510a940c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af5c72d-b0e9-4a2e-a14f-60510a940c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18347510-8822-42a8-b39d-4c387d65e41a', 'volume_name': 'volume-18347510-8822-42a8-b39d-4c387d65e41a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0370fd79-5a15-40ab-bfc3-efdb79452d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0370fd79-5a15-40ab-bfc3-efdb79452d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b3899b-1bfc-45b0-a31a-8976d3d74795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:31 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Volume 18347510-8822-42a8-b39d-4c387d65e41a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18347510-8822-42a8-b39d-4c387d65e41a', 'volume_size': 1} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-680988120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18347510-8822-42a8-b39d-4c387d65e41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d7cb9ebc345b3a1eba793f61793f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:31Z,use_quota=True,user_id='f69a55be72414c68ab7eb78b46ee1e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Creating volume 18347510-8822-42a8-b39d-4c387d65e41a {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:31 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240" returned: 0 in 0.631s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:31 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a 1073741824 Sep 09 03:46:31 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:31 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240 Sep 09 03:46:31 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" acquired by "delete_volume" :: waited 0.048s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[707e3f83-2710-4a3c-b97f-9441aae1ee8a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:32 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 Sep 09 03:46:32 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:32 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e9b06c22-f286-4233-b408-6eb4a31d5240" returned: 0 in 0.416s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Lock "cinder-quobyte-e9b06c22-f286-4233-b408-6eb4a31d5240" released by "delete_volume" :: held 1.113s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Created reservations ['b59a121f-2df2-454e-a396-670d9c26ffc7', '1095bffe-eff2-4dad-9b21-ac35ff4deb96', '47b0d16b-325d-4703-8ebc-5b43f9e490ca', '98bea0c4-002a-4a34-920e-8bda0b1aff05'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:32 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:32 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:32 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a 1073741824" returned: 0 in 0.688s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:32 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a Sep 09 03:46:32 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:32 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" returned: 0 in 0.599s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:32 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80 Sep 09 03:46:32 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:32 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.329s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Deleted volume successfully. Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ff8c30c-885f-49c3-af0f-aa1b2aa69abb tempest-VolumesActionsTest-712279661 None] Lock "cinder-e9b06c22-f286-4233-b408-6eb4a31d5240-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:32 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a" returned: 0 in 0.274s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b3899b-1bfc-45b0-a31a-8976d3d74795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18347510-8822-42a8-b39d-4c387d65e41a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71c9545-e896-44f0-a631-5141ae414a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Volume volume-18347510-8822-42a8-b39d-4c387d65e41a (18347510-8822-42a8-b39d-4c387d65e41a): created successfully Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71c9545-e896-44f0-a631-5141ae414a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Flow 'volume_create_manager' (46d7c020-532c-4891-92c1-d300768f9b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f20f7741-b845-410c-8f80-297bf1858d28 tempest-VolumesTransfersV357Test-1184527794 None] Created volume successfully. Sep 09 03:46:32 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" returned: 0 in 0.282s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-3771f0bc-ba9b-4fd3-a76a-70f5768caf80" released by "delete_volume" :: held 0.995s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:32 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['41effd87-c903-4338-a77a-07023f11b086'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:33 devstack cinder-volume[87597]: WARNING cinder.db.api [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-510640938'] Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['cd594186-dcd8-4683-b891-f3d1c4b5aa1b', '38484832-29e6-412d-8b6a-989196a1eff4', 'f7d95ab6-11ea-4271-9856-1d3e470edbaf', '202eddc8-574e-4e23-96ac-9e9a39828988'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:33 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:33 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:33 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.288s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:33 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:33 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-624a09d2-7469-4a0e-a044-5aebc8bc79e9 tempest-GroupSnapshotsTest-1175724365 None] Delete group completed successfully. Sep 09 03:46:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1fe07f24-7386-4142-a3d4-10bb2e7082cf tempest-GroupSnapshotsTest-1175724365 None] Group tempest-GroupSnapshotsTest-Group-1670019310: creating Sep 09 03:46:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5b58c5bb-0803-40a5-907b-64404a2616b6 tempest-VolumesTransfersV357Test-1265231036 None] Transfer volume completed successfully. Sep 09 03:46:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1fe07f24-7386-4142-a3d4-10bb2e7082cf tempest-GroupSnapshotsTest-1175724365 None] Group tempest-GroupSnapshotsTest-Group-1670019310: created successfully Sep 09 03:46:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1fe07f24-7386-4142-a3d4-10bb2e7082cf tempest-GroupSnapshotsTest-1175724365 None] Create group completed successfully. Sep 09 03:46:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Acquiring lock "cinder-18347510-8822-42a8-b39d-4c387d65e41a-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Lock "cinder-18347510-8822-42a8-b39d-4c387d65e41a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Acquiring lock "cinder-quobyte-18347510-8822-42a8-b39d-4c387d65e41a" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Lock "cinder-quobyte-18347510-8822-42a8-b39d-4c387d65e41a" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:36 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b468015-91ac-476c-b966-35fde924ca81]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:36 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:36 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a Sep 09 03:46:36 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Flow 'volume_create_manager' (67847d90-f48e-49c8-b8aa-0ea3c3293623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046dce24-9650-43bd-9c78-79239dda14d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046dce24-9650-43bd-9c78-79239dda14d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1299741506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=184c45df-a7f0-4ee0-8f85-5aaf84b1cbd0,host='devstack@QuobyteHD#QuobyteHD',id=5e5fddf5-e64c-4564-8e35-2afc86383314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a222cbd362480a905e4927ffe680be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:37Z,use_quota=True,user_id='94173180af28483b9f09b2e06ca6e4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(882122b2-f20f-4347-b2f2-5b529fb98fb7),volume_type_id=882122b2-f20f-4347-b2f2-5b529fb98fb7)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11761038-f44d-4e3f-ab6e-3784d776c091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11761038-f44d-4e3f-ab6e-3784d776c091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc3cdfa-e4c6-4fba-b176-5269cde9558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc3cdfa-e4c6-4fba-b176-5269cde9558f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5fddf5-e64c-4564-8e35-2afc86383314', 'volume_name': 'volume-5e5fddf5-e64c-4564-8e35-2afc86383314', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ccfbe8-e867-43bf-90f9-4141b2051a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ccfbe8-e867-43bf-90f9-4141b2051a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc4376e-0ef3-41f4-b327-b6b40db46ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Volume 5e5fddf5-e64c-4564-8e35-2afc86383314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5fddf5-e64c-4564-8e35-2afc86383314', 'volume_size': 1} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=184c45df-a7f0-4ee0-8f85-5aaf84b1cbd0,created_at=2026-09-09T01:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1299741506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=184c45df-a7f0-4ee0-8f85-5aaf84b1cbd0,host='devstack@QuobyteHD#QuobyteHD',id=5e5fddf5-e64c-4564-8e35-2afc86383314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a222cbd362480a905e4927ffe680be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:37Z,use_quota=True,user_id='94173180af28483b9f09b2e06ca6e4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(882122b2-f20f-4347-b2f2-5b529fb98fb7),volume_type_id=882122b2-f20f-4347-b2f2-5b529fb98fb7)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Creating volume 5e5fddf5-e64c-4564-8e35-2afc86383314 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:37 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:37 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 1073741824 Sep 09 03:46:37 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:37 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a" returned: 0 in 0.600s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:37 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:37 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:37 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a Sep 09 03:46:37 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:37 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.426s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (3096ff03-c06f-4040-805f-2ef1871f35ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46c6766-e003-4b6c-8631-ae7368f15384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46c6766-e003-4b6c-8631-ae7368f15384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827219981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a5a236-ad8b-42da-b1e8-bbd86914eace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:38Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b1f8dd-177b-4074-99d7-98d3892f0570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b1f8dd-177b-4074-99d7-98d3892f0570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21c143c-9c48-42ab-ad9e-6f01e6e7fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21c143c-9c48-42ab-ad9e-6f01e6e7fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a5a236-ad8b-42da-b1e8-bbd86914eace', 'volume_name': 'volume-12a5a236-ad8b-42da-b1e8-bbd86914eace', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03beaa00-9478-486b-9300-9cd8887a32af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03beaa00-9478-486b-9300-9cd8887a32af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a251ae4e-5656-4d6c-a319-871684def290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Volume 12a5a236-ad8b-42da-b1e8-bbd86914eace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a5a236-ad8b-42da-b1e8-bbd86914eace', 'volume_size': 1} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-18347510-8822-42a8-b39d-4c387d65e41a" returned: 0 in 0.502s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 1073741824" returned: 0 in 0.775s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Lock "cinder-quobyte-18347510-8822-42a8-b39d-4c387d65e41a" released by "delete_volume" :: held 1.177s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:37 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 Sep 09 03:46:37 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:37 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Created reservations ['c04ae91a-76b9-45ee-940e-187ac575179d', 'b0c9684d-db0d-4d21-ab30-db706e77142e', 'e6c34b1d-2a6f-40f4-a624-fff802af8e3c', 'c6ca9f9f-86c6-4998-803a-642430e6c114'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:38 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:38 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:38 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314" returned: 0 in 0.274s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827219981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a5a236-ad8b-42da-b1e8-bbd86914eace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:38Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Creating volume 12a5a236-ad8b-42da-b1e8-bbd86914eace {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:38 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc4376e-0ef3-41f4-b327-b6b40db46ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5fddf5-e64c-4564-8e35-2afc86383314', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19eccda-0ca7-47ac-b735-455aeb24733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Volume volume-5e5fddf5-e64c-4564-8e35-2afc86383314 (5e5fddf5-e64c-4564-8e35-2afc86383314): created successfully Sep 09 03:46:38 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace 1073741824 Sep 09 03:46:38 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19eccda-0ca7-47ac-b735-455aeb24733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Flow 'volume_create_manager' (67847d90-f48e-49c8-b8aa-0ea3c3293623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:38 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:38 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9bd55ea7-22a8-4455-9a3a-9702fcb057b7 tempest-GroupSnapshotsTest-1175724365 None] Created volume successfully. Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.295s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:38 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Deleted volume successfully. Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7af86132-0ac8-4ad2-86bf-726e19363dd0 tempest-VolumesTransfersV357Test-243061362 None] Lock "cinder-18347510-8822-42a8-b39d-4c387d65e41a-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:38 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace 1073741824" returned: 0 in 0.493s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=112,cinder:DELETE=10,cinder:INSERT=30,cinder:UPDATE=122 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:46:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:38 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace Sep 09 03:46:38 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:39 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace" returned: 0 in 0.271s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a251ae4e-5656-4d6c-a319-871684def290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a5a236-ad8b-42da-b1e8-bbd86914eace', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2430025-4d9c-4ecd-b47f-65f0d3443ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Volume volume-12a5a236-ad8b-42da-b1e8-bbd86914eace (12a5a236-ad8b-42da-b1e8-bbd86914eace): created successfully Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2430025-4d9c-4ecd-b47f-65f0d3443ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (3096ff03-c06f-4040-805f-2ef1871f35ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9585c273-c957-4d9f-bbd8-e4b74a8fbd1f tempest-VolumesActionsTest-712279661 None] Created volume successfully. Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Flow 'volume_create_manager' (9477133e-a5d9-4f63-a114-a40aee128674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc10e96-c07c-428c-afe7-5ae451b23c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc10e96-c07c-428c-afe7-5ae451b23c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-667563268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c9e4c3-6fa7-477a-af36-2a4312e4f4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d7cb9ebc345b3a1eba793f61793f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:39Z,use_quota=True,user_id='f69a55be72414c68ab7eb78b46ee1e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32c5134-df3a-4b1e-9bd1-c51093000726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32c5134-df3a-4b1e-9bd1-c51093000726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6393c9fc-39bc-4719-bef7-5d11e938d33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6393c9fc-39bc-4719-bef7-5d11e938d33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c9e4c3-6fa7-477a-af36-2a4312e4f4ff', 'volume_name': 'volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b36af0-e927-463c-96d5-5a0c973e5063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b36af0-e927-463c-96d5-5a0c973e5063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad4bbc8-5f0a-4c9a-a42f-98adf16cc15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Volume 67c9e4c3-6fa7-477a-af36-2a4312e4f4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff', 'volume_size': 1} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-667563268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c9e4c3-6fa7-477a-af36-2a4312e4f4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1d7cb9ebc345b3a1eba793f61793f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:39Z,use_quota=True,user_id='f69a55be72414c68ab7eb78b46ee1e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Creating volume 67c9e4c3-6fa7-477a-af36-2a4312e4f4ff {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:39 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:39 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff 1073741824 Sep 09 03:46:39 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-12a5a236-ad8b-42da-b1e8-bbd86914eace-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Lock "cinder-12a5a236-ad8b-42da-b1e8-bbd86914eace-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-quobyte-12a5a236-ad8b-42da-b1e8-bbd86914eace" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Lock "cinder-quobyte-12a5a236-ad8b-42da-b1e8-bbd86914eace" acquired by "delete_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a9dc00-7948-4605-a6f1-6b07e9d74137]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:40 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace Sep 09 03:46:40 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Flow 'volume_create_manager' (b6d914fc-c9e8-4732-ab40-f3b1630ecd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7caefc95-e3d3-4aa2-bf64-061bb47d481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7caefc95-e3d3-4aa2-bf64-061bb47d481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1500125306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=184c45df-a7f0-4ee0-8f85-5aaf84b1cbd0,host='devstack@QuobyteHD#QuobyteHD',id=66e34527-bcfc-41de-95b5-6072e50f93f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a222cbd362480a905e4927ffe680be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:40Z,use_quota=True,user_id='94173180af28483b9f09b2e06ca6e4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(882122b2-f20f-4347-b2f2-5b529fb98fb7),volume_type_id=882122b2-f20f-4347-b2f2-5b529fb98fb7)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b78542-c07b-49e6-9f9f-f2396877abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b78542-c07b-49e6-9f9f-f2396877abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b2af0a-578c-49aa-a79a-9bdff5003687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b2af0a-578c-49aa-a79a-9bdff5003687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e34527-bcfc-41de-95b5-6072e50f93f7', 'volume_name': 'volume-66e34527-bcfc-41de-95b5-6072e50f93f7', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96b8639-8f2d-4e77-9aa4-0838d903fda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96b8639-8f2d-4e77-9aa4-0838d903fda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b49a968-a8f8-423c-9b2c-cd22264d607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:40 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Volume 66e34527-bcfc-41de-95b5-6072e50f93f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e34527-bcfc-41de-95b5-6072e50f93f7', 'volume_size': 1} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:40 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff 1073741824" returned: 0 in 0.852s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:40 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff Sep 09 03:46:40 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:40 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace" returned: 0 in 0.484s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:40 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace Sep 09 03:46:40 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:40 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff" returned: 0 in 0.273s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=184c45df-a7f0-4ee0-8f85-5aaf84b1cbd0,created_at=2026-09-09T01:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1500125306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=184c45df-a7f0-4ee0-8f85-5aaf84b1cbd0,host='devstack@QuobyteHD#QuobyteHD',id=66e34527-bcfc-41de-95b5-6072e50f93f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a222cbd362480a905e4927ffe680be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:40Z,use_quota=True,user_id='94173180af28483b9f09b2e06ca6e4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(882122b2-f20f-4347-b2f2-5b529fb98fb7),volume_type_id=882122b2-f20f-4347-b2f2-5b529fb98fb7)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Creating volume 66e34527-bcfc-41de-95b5-6072e50f93f7 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:40 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad4bbc8-5f0a-4c9a-a42f-98adf16cc15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:40 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 1073741824 Sep 09 03:46:40 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a316662-d46e-442a-8a5d-5e81239f8a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:40 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Volume volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff (67c9e4c3-6fa7-477a-af36-2a4312e4f4ff): created successfully Sep 09 03:46:40 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a316662-d46e-442a-8a5d-5e81239f8a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Flow 'volume_create_manager' (9477133e-a5d9-4f63-a114-a40aee128674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-12a5a236-ad8b-42da-b1e8-bbd86914eace" returned: 0 in 0.278s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Lock "cinder-quobyte-12a5a236-ad8b-42da-b1e8-bbd86914eace" released by "delete_volume" :: held 0.822s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:40 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b0a75767-c8e9-416d-9c63-e0dd353a8dda tempest-VolumesTransfersV357Test-1184527794 None] Created volume successfully. Sep 09 03:46:40 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Created reservations ['a3397295-997b-4937-b810-75f3c0265dfe', '1cf1e4a1-24c7-487b-89dc-68779afc0f1c', '11cd0879-7762-4b54-949d-ad80cf97f2a5', '21735ff8-15ba-46f1-b28a-9c0b3bcfb7cb'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:41 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:41 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:41 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.268s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:41 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 1073741824" returned: 0 in 0.496s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Deleted volume successfully. Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5189b28f-a177-457b-a025-8447d88ff029 tempest-VolumesActionsTest-1543023399 None] Lock "cinder-12a5a236-ad8b-42da-b1e8-bbd86914eace-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:41 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 Sep 09 03:46:41 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:41 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b49a968-a8f8-423c-9b2c-cd22264d607e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e34527-bcfc-41de-95b5-6072e50f93f7', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e361b670-8516-4c23-bf6b-1e80455312d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:41 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Volume volume-66e34527-bcfc-41de-95b5-6072e50f93f7 (66e34527-bcfc-41de-95b5-6072e50f93f7): created successfully Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e361b670-8516-4c23-bf6b-1e80455312d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Flow 'volume_create_manager' (b6d914fc-c9e8-4732-ab40-f3b1630ecd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e437e9be-7c93-4f7a-9fd9-8a716e415b2c tempest-GroupSnapshotsTest-1175724365 None] Created volume successfully. Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (63adb990-b631-458d-ba0f-87d4837090d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c13d96-bfd3-4221-8486-944799e9a95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c13d96-bfd3-4221-8486-944799e9a95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-108692186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c79825-2438-468e-9024-f76104a34723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:42Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2004f1bf-30eb-4724-b8b0-177399b1f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2004f1bf-30eb-4724-b8b0-177399b1f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b99265-9bc6-4fb5-978e-be30350f6f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b99265-9bc6-4fb5-978e-be30350f6f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c79825-2438-468e-9024-f76104a34723', 'volume_name': 'volume-37c79825-2438-468e-9024-f76104a34723', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b194f-bd20-40f1-b7a0-4c440e8dd0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b194f-bd20-40f1-b7a0-4c440e8dd0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a60cdd-2acb-42c6-93a1-166defd5cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:41 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Volume 37c79825-2438-468e-9024-f76104a34723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c79825-2438-468e-9024-f76104a34723', 'volume_size': 1} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-108692186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c79825-2438-468e-9024-f76104a34723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:42Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Creating volume 37c79825-2438-468e-9024-f76104a34723 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:41 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:41 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 1073741824 Sep 09 03:46:41 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Acquiring lock "cinder-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Lock "cinder-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Acquiring lock "cinder-quobyte-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Lock "cinder-quobyte-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9087165-4b50-4126-ab65-a919ac81d623]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:42 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff Sep 09 03:46:42 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:42 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 1073741824" returned: 0 in 0.432s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:42 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 Sep 09 03:46:42 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:42 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff" returned: 0 in 0.361s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:42 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff Sep 09 03:46:42 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:42 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723" returned: 0 in 0.251s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a60cdd-2acb-42c6-93a1-166defd5cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c79825-2438-468e-9024-f76104a34723', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee74839d-5b84-4392-b44b-9e75626262ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:42 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Volume volume-37c79825-2438-468e-9024-f76104a34723 (37c79825-2438-468e-9024-f76104a34723): created successfully Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee74839d-5b84-4392-b44b-9e75626262ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (63adb990-b631-458d-ba0f-87d4837090d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-99ce5878-954c-44aa-88e4-a8f6626f6513 tempest-VolumesActionsTest-712279661 None] Created volume successfully. Sep 09 03:46:42 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff" returned: 0 in 0.273s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Lock "cinder-quobyte-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff" released by "delete_volume" :: held 0.674s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Created reservations ['dffc16ce-8dd3-4fa9-b0e0-657dcc082640', 'bc3fc4bb-6cc5-4270-9d09-1edbb3dff384', 'fb3b0dbf-5e75-4494-ade0-9ddd028fa67f', '1863c4ec-2781-4d4c-a977-98d3534312fe'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:42 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:42 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-37c79825-2438-468e-9024-f76104a34723-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Lock "cinder-37c79825-2438-468e-9024-f76104a34723-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4bb30f4e-1c67-47fb-ab03-63df2af880aa tempest-GroupSnapshotsTest-1175724365 None] Update group completed successfully. Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-quobyte-37c79825-2438-468e-9024-f76104a34723" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Lock "cinder-quobyte-37c79825-2438-468e-9024-f76104a34723" acquired by "delete_volume" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[985f4414-dd5c-4dc7-8847-1b16be904bff]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:43 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.312s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Deleted volume successfully. Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93342e9c-e144-4cbe-a5d4-ed57dd6955b1 tempest-VolumesTransfersV357Test-243061362 None] Lock "cinder-67c9e4c3-6fa7-477a-af36-2a4312e4f4ff-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:43 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 Sep 09 03:46:43 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:43 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723" returned: 0 in 0.385s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:43 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723 Sep 09 03:46:43 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:43 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c79825-2438-468e-9024-f76104a34723" returned: 0 in 0.256s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Lock "cinder-quobyte-37c79825-2438-468e-9024-f76104a34723" released by "delete_volume" :: held 0.696s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Created reservations ['103d0a9e-ba36-4771-b1ba-a548dcee7b71', '0e6defa6-27bc-47bc-a91a-50902aee4fe3', '1bd1cd20-139e-4fb7-9f0e-54925009c0fd', '5664884e-1bd3-4ef6-9fa9-8fa12605f36a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:43 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:43 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:44 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.291s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:44 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Deleted volume successfully. Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-adaa6618-0e0b-41fd-81c5-bdf8cfc68cca tempest-VolumesActionsTest-1543023399 None] Lock "cinder-37c79825-2438-468e-9024-f76104a34723-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:44 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-271b7245-9f94-48a0-8002-6e377be22bf0 tempest-GroupSnapshotsTest-1175724365 None] Update group completed successfully. Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (abfb8240-c513-43f8-9341-bc19fe2873c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f333a0b1-4dba-46d5-886b-817e0e9a4b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f333a0b1-4dba-46d5-886b-817e0e9a4b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827488246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dc09bb-9fef-4397-b70b-91a7449600e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:45Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c973ddaf-f6da-4cbd-8714-9f7d5eea7d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c973ddaf-f6da-4cbd-8714-9f7d5eea7d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419ec58c-cf1c-4e3d-bdcc-25c7d270a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419ec58c-cf1c-4e3d-bdcc-25c7d270a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9dc09bb-9fef-4397-b70b-91a7449600e5', 'volume_name': 'volume-c9dc09bb-9fef-4397-b70b-91a7449600e5', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b472934-3e50-4389-ab0e-255d269f48d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b472934-3e50-4389-ab0e-255d269f48d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9960f7ba-70c1-4b70-bd2d-ba7891756e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:44 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Volume c9dc09bb-9fef-4397-b70b-91a7449600e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9dc09bb-9fef-4397-b70b-91a7449600e5', 'volume_size': 1} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827488246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dc09bb-9fef-4397-b70b-91a7449600e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:45Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Creating volume c9dc09bb-9fef-4397-b70b-91a7449600e5 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:44 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:44 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 1073741824 Sep 09 03:46:44 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:45 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 1073741824" returned: 0 in 0.451s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:45 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 Sep 09 03:46:45 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a96ddf83-9c0f-4e0e-b0ff-5e1035ad8893 tempest-GroupSnapshotsTest-1175724365 None] Update group completed successfully. Sep 09 03:46:45 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5" returned: 0 in 0.271s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9960f7ba-70c1-4b70-bd2d-ba7891756e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9dc09bb-9fef-4397-b70b-91a7449600e5', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424f00e7-d676-4fdd-b96f-3d62d11101c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:45 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Volume volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 (c9dc09bb-9fef-4397-b70b-91a7449600e5): created successfully Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424f00e7-d676-4fdd-b96f-3d62d11101c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (abfb8240-c513-43f8-9341-bc19fe2873c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1f3b40a5-d65a-4939-8302-ba1126f061ee tempest-VolumesActionsTest-712279661 None] Created volume successfully. Sep 09 03:46:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5ce8a714-b941-40ce-8660-c2790ef84187 tempest-GroupSnapshotsTest-1175724365 None] Update group completed successfully. Sep 09 03:46:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-c9dc09bb-9fef-4397-b70b-91a7449600e5-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Lock "cinder-c9dc09bb-9fef-4397-b70b-91a7449600e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-quobyte-c9dc09bb-9fef-4397-b70b-91a7449600e5" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Lock "cinder-quobyte-c9dc09bb-9fef-4397-b70b-91a7449600e5" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[27255a48-ef48-4155-a2b5-d85ee5908259]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:47 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 Sep 09 03:46:47 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:47 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5" returned: 0 in 0.404s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:47 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5 Sep 09 03:46:47 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:47 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c9dc09bb-9fef-4397-b70b-91a7449600e5" returned: 0 in 0.282s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Lock "cinder-quobyte-c9dc09bb-9fef-4397-b70b-91a7449600e5" released by "delete_volume" :: held 0.737s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:47 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Created reservations ['fc7b143e-08f6-42cd-ac44-27a55709d600', '3ab0deff-1e1c-49ce-9d98-df8877804d77', 'd245f24d-b41f-4505-bb44-a9b5dfca3e91', '2e3ad11c-6cc3-4998-b961-35254afe37df'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:48 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:48 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:48 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.390s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Deleted volume successfully. Sep 09 03:46:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] GroupSnapshot 21fd5797-6fbc-4ebe-87e5-70ce3648b374: creating. Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Group snapshot 21fd5797-6fbc-4ebe-87e5-70ce3648b374: creating. {{(pid=87597) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5ca0875-bdac-4b64-94d2-aa200e6757fe tempest-VolumesActionsTest-1543023399 None] Lock "cinder-c9dc09bb-9fef-4397-b70b-91a7449600e5-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Creating offline snapshot 376bb6b0-deda-4056-9cce-acce31473367 of volume 66e34527-bcfc-41de-95b5-6072e50f93f7 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b75c52-3c7c-487c-bd88-4bbb16c43c64]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:48 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 Sep 09 03:46:48 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:49 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7" returned: 0 in 0.568s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:49 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 1G Sep 09 03:46:49 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (b35bdf33-559a-4713-802e-ca69802af945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7a3816-9f83-496a-bb13-71cc985775d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7a3816-9f83-496a-bb13-71cc985775d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2125676232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5726680d-3ad6-443e-81a7-abc9bba1cd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:49Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e72748-480f-40f7-a7ff-1f2aeca0741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e72748-480f-40f7-a7ff-1f2aeca0741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8651c7-77ec-4eb1-8632-30c9ae3ee7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8651c7-77ec-4eb1-8632-30c9ae3ee7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5726680d-3ad6-443e-81a7-abc9bba1cd73', 'volume_name': 'volume-5726680d-3ad6-443e-81a7-abc9bba1cd73', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6a3600-e934-4b6d-9d15-48e3cdc88d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6a3600-e934-4b6d-9d15-48e3cdc88d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706d93f0-bf5e-4e42-ac86-a8fea558dd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:49 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Volume 5726680d-3ad6-443e-81a7-abc9bba1cd73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5726680d-3ad6-443e-81a7-abc9bba1cd73', 'volume_size': 1} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:49 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 1G" returned: 0 in 0.704s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e34527-bcfc-41de-95b5-6072e50f93f7 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:49 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e34527-bcfc-41de-95b5-6072e50f93f7 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 Sep 09 03:46:49 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:50 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e34527-bcfc-41de-95b5-6072e50f93f7 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367" returned: 0 in 0.425s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:50 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:46:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:50 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 Sep 09 03:46:50 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:50 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367" returned: 0 in 0.341s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:50 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.info Sep 09 03:46:50 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:51 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.info" returned: 0 in 0.360s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:51 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:51 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.info Sep 09 03:46:51 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:51 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.info" returned: 0 in 0.357s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.905s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Creating offline snapshot 88faf272-c987-4695-9d88-00ec42c91ba7 of volume 5e5fddf5-e64c-4564-8e35-2afc86383314 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcfef1f-f5ab-423d-b4f8-1efe7745f80f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:51 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 Sep 09 03:46:51 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:51 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314" returned: 0 in 0.389s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:51 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 1G Sep 09 03:46:51 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:52 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 1G" returned: 0 in 0.517s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5fddf5-e64c-4564-8e35-2afc86383314 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:52 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5fddf5-e64c-4564-8e35-2afc86383314 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 Sep 09 03:46:52 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:52 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5fddf5-e64c-4564-8e35-2afc86383314 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7" returned: 0 in 0.326s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:52 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:46:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:52 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 Sep 09 03:46:52 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:53 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7" returned: 0 in 0.290s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:53 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.info Sep 09 03:46:53 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Acquiring lock "cinder-4ed25120-77d4-4510-b6df-22a23ce76f26-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "cinder-4ed25120-77d4-4510-b6df-22a23ce76f26-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Acquiring lock "cinder-quobyte-4ed25120-77d4-4510-b6df-22a23ce76f26" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "cinder-quobyte-4ed25120-77d4-4510-b6df-22a23ce76f26" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c2727-7c5f-4418-a415-b17586ea9936]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:53 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.info" returned: 0 in 0.336s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:53 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:53 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.info Sep 09 03:46:53 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:53 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 Sep 09 03:46:53 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:53 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.info" returned: 0 in 0.254s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.386s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2125676232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5726680d-3ad6-443e-81a7-abc9bba1cd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:49Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Creating volume 5726680d-3ad6-443e-81a7-abc9bba1cd73 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:53 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:53 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26" returned: 0 in 0.412s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:53 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 1073741824 Sep 09 03:46:53 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:53 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26 Sep 09 03:46:53 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:53 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-bd2abdcf-50cb-4f08-83dd-286bf0b534b4 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot 21fd5797-6fbc-4ebe-87e5-70ce3648b374: created successfully Sep 09 03:46:54 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ed25120-77d4-4510-b6df-22a23ce76f26" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "cinder-quobyte-4ed25120-77d4-4510-b6df-22a23ce76f26" released by "delete_volume" :: held 0.828s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Created reservations ['35134ed0-a928-4097-9f76-fdf09ce4ef9b', 'd11c8376-d54c-4d20-b17c-ec3dcc5f300e', 'aec17685-9531-4875-a021-7be44aa3a67d', '3a7f3287-1e19-4f55-b7ff-c5f26ccd60d8'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:54 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 1073741824" returned: 0 in 0.547s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:54 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:54 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:54 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 Sep 09 03:46:54 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:54 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.352s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Deleted volume successfully. Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2aaab0bc-8ea0-4d52-9bbd-caa85d401240 tempest-AttachVolumeShelveTestJSON-1895824303 None] Lock "cinder-4ed25120-77d4-4510-b6df-22a23ce76f26-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:54 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73" returned: 0 in 0.357s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706d93f0-bf5e-4e42-ac86-a8fea558dd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5726680d-3ad6-443e-81a7-abc9bba1cd73', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5362cecb-2832-42db-b502-c5ccd13da409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:54 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Volume volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 (5726680d-3ad6-443e-81a7-abc9bba1cd73): created successfully Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5362cecb-2832-42db-b502-c5ccd13da409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (b35bdf33-559a-4713-802e-ca69802af945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e7f4599d-930f-4bef-8b38-3799a2692599 tempest-VolumesActionsTest-712279661 None] Created volume successfully. Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Flow 'volume_create_manager' (0f382332-1013-46a0-af05-f3358dd23ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2bbf88-a601-4d9e-9397-678d6f950124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2bbf88-a601-4d9e-9397-678d6f950124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1379433366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93073098-e6de-4e73-acea-b9e29867bc84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f61973188ff8470dbc409be5ac543c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:55Z,use_quota=True,user_id='0c3362fce2554298abc8dc0aa81045ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc0ecf1-6b93-4ddd-8344-b91ac12361be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc0ecf1-6b93-4ddd-8344-b91ac12361be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a29cea-18d4-48f7-9070-4ecb29e4d835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a29cea-18d4-48f7-9070-4ecb29e4d835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93073098-e6de-4e73-acea-b9e29867bc84', 'volume_name': 'volume-93073098-e6de-4e73-acea-b9e29867bc84', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f41b65-ac94-4876-ae26-391a1b1b2340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f41b65-ac94-4876-ae26-391a1b1b2340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a08309-7cee-493a-98ec-251a8f0ffa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:54 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Volume 93073098-e6de-4e73-acea-b9e29867bc84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93073098-e6de-4e73-acea-b9e29867bc84', 'volume_size': 1} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1379433366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93073098-e6de-4e73-acea-b9e29867bc84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f61973188ff8470dbc409be5ac543c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:55Z,use_quota=True,user_id='0c3362fce2554298abc8dc0aa81045ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Creating volume 93073098-e6de-4e73-acea-b9e29867bc84 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:54 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:55 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 1073741824 Sep 09 03:46:55 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:55 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot 21fd5797-6fbc-4ebe-87e5-70ce3648b374: deleting Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot 21fd5797-6fbc-4ebe-87e5-70ce3648b374: deleting {{(pid=87597) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-66e34527-bcfc-41de-95b5-6072e50f93f7" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-66e34527-bcfc-41de-95b5-6072e50f93f7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-376bb6b0-deda-4056-9cce-acce31473367" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-376bb6b0-deda-4056-9cce-acce31473367" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Deleting offline snapshot 376bb6b0-deda-4056-9cce-acce31473367 of volume 66e34527-bcfc-41de-95b5-6072e50f93f7 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] snapshot_file for this snap is: volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a936cb-c425-4cd6-b079-82f12d50aed4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:55 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 Sep 09 03:46:55 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:55 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 1073741824" returned: 0 in 0.619s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:55 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 Sep 09 03:46:55 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:55 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367" returned: 0 in 0.476s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66e34527-bcfc-41de-95b5-6072e50f93f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca05125b-6d43-4f38-8fbc-a37c876c016e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-5726680d-3ad6-443e-81a7-abc9bba1cd73-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Lock "cinder-5726680d-3ad6-443e-81a7-abc9bba1cd73-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:55 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 Sep 09 03:46:55 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:55 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84" returned: 0 in 0.319s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Acquiring lock "cinder-quobyte-5726680d-3ad6-443e-81a7-abc9bba1cd73" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a08309-7cee-493a-98ec-251a8f0ffa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93073098-e6de-4e73-acea-b9e29867bc84', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b42cd58-e27c-4098-bf15-81ba06d46101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Lock "cinder-quobyte-5726680d-3ad6-443e-81a7-abc9bba1cd73" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:56 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Volume volume-93073098-e6de-4e73-acea-b9e29867bc84 (93073098-e6de-4e73-acea-b9e29867bc84): created successfully Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b42cd58-e27c-4098-bf15-81ba06d46101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Flow 'volume_create_manager' (0f382332-1013-46a0-af05-f3358dd23ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca81638f-e6fd-4b4a-92ab-4c7a5e66d197]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-7464bfb5-65b1-465d-936d-b128564f0613 tempest-VolumesListTestJSON-1888361728 None] Created volume successfully. Sep 09 03:46:56 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 Sep 09 03:46:56 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:56 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7" returned: 0 in 0.512s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:56 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 Sep 09 03:46:56 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:56 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73" returned: 0 in 0.422s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:56 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73 Sep 09 03:46:56 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:56 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367" returned: 0 in 0.373s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:56 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367 Sep 09 03:46:56 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:56 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5726680d-3ad6-443e-81a7-abc9bba1cd73" returned: 0 in 0.269s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Lock "cinder-quobyte-5726680d-3ad6-443e-81a7-abc9bba1cd73" released by "delete_volume" :: held 0.753s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Created reservations ['3477dc0f-5ee2-4c6c-9749-d504e6f978e6', '17ad1df9-d022-433c-9e65-30a99062df41', '4c3c80dc-283b-417f-94c6-ecda53c48321', '266e224a-d083-4be7-8251-20d912b89383'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:56 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:46:56 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:56 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7.376bb6b0-deda-4056-9cce-acce31473367" returned: 0 in 0.279s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-376bb6b0-deda-4056-9cce-acce31473367" released by "_delete_snapshot" :: held 1.814s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-66e34527-bcfc-41de-95b5-6072e50f93f7" released by "delete_snapshot" :: held 1.867s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-5e5fddf5-e64c-4564-8e35-2afc86383314" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-5e5fddf5-e64c-4564-8e35-2afc86383314" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-88faf272-c987-4695-9d88-00ec42c91ba7" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-88faf272-c987-4695-9d88-00ec42c91ba7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Deleting offline snapshot 88faf272-c987-4695-9d88-00ec42c91ba7 of volume 5e5fddf5-e64c-4564-8e35-2afc86383314 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] snapshot_file for this snap is: volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a2e695-c421-4299-9658-7ff3f05ce86e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:57 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.379s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:46:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Deleted volume successfully. Sep 09 03:46:57 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 Sep 09 03:46:57 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-87341934-c307-4e61-a0c9-bdbe83812d8a tempest-VolumesActionsTest-1543023399 None] Lock "cinder-5726680d-3ad6-443e-81a7-abc9bba1cd73-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:57 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7" returned: 0 in 0.559s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5fddf5-e64c-4564-8e35-2afc86383314(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[81012606-4248-4939-9489-32eda75e012b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:57 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 Sep 09 03:46:57 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Flow 'volume_create_manager' (d0e73054-f6d9-4b30-a950-f8613ce86052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ab685d-2ec8-4b8a-a111-cd807996109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ab685d-2ec8-4b8a-a111-cd807996109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-382750515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae85058-e874-4a10-bd46-a15c4863f5c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f61973188ff8470dbc409be5ac543c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:58Z,use_quota=True,user_id='0c3362fce2554298abc8dc0aa81045ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3cd3e0-1bd8-4c2b-8e4b-aa3460d4b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3cd3e0-1bd8-4c2b-8e4b-aa3460d4b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f140fc7c-250a-4bdf-bcbb-5aadc4b796fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f140fc7c-250a-4bdf-bcbb-5aadc4b796fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae85058-e874-4a10-bd46-a15c4863f5c2', 'volume_name': 'volume-4ae85058-e874-4a10-bd46-a15c4863f5c2', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022a3b9f-8d1a-40aa-85c6-999555aaf394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022a3b9f-8d1a-40aa-85c6-999555aaf394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74440bb1-fc5c-4d14-8ac8-ff70b5928a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Volume 4ae85058-e874-4a10-bd46-a15c4863f5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae85058-e874-4a10-bd46-a15c4863f5c2', 'volume_size': 1} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-382750515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae85058-e874-4a10-bd46-a15c4863f5c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f61973188ff8470dbc409be5ac543c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:58Z,use_quota=True,user_id='0c3362fce2554298abc8dc0aa81045ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Creating volume 4ae85058-e874-4a10-bd46-a15c4863f5c2 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:58 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:46:58 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 1073741824 Sep 09 03:46:58 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (461323cd-c26a-4ccb-938a-d9a2b4c50f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41cbe08-0098-46c1-ac33-4791766888ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314" returned: 0 in 0.394s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:58 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 Sep 09 03:46:58 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41cbe08-0098-46c1-ac33-4791766888ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-509754768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5903279-c57f-4d72-b882-245b6919a8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:58Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a262495-905e-4754-a9d3-adecbaf1b77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a262495-905e-4754-a9d3-adecbaf1b77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a88939-ea1b-44d6-af00-9af1f7a383e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a88939-ea1b-44d6-af00-9af1f7a383e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5903279-c57f-4d72-b882-245b6919a8e1', 'volume_name': 'volume-c5903279-c57f-4d72-b882-245b6919a8e1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3f2f45-be6e-45ec-ba7b-56a0bb8f1b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3f2f45-be6e-45ec-ba7b-56a0bb8f1b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca07a751-97e2-4400-8ac0-dbb98a518c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Volume c5903279-c57f-4d72-b882-245b6919a8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5903279-c57f-4d72-b882-245b6919a8e1', 'volume_size': 1} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:58 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7" returned: 0 in 0.473s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:58 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7 Sep 09 03:46:58 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:58 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 1073741824" returned: 0 in 0.574s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:58 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 Sep 09 03:46:58 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:58 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314.88faf272-c987-4695-9d88-00ec42c91ba7" returned: 0 in 0.296s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-88faf272-c987-4695-9d88-00ec42c91ba7" released by "_delete_snapshot" :: held 1.858s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-5e5fddf5-e64c-4564-8e35-2afc86383314" released by "delete_snapshot" :: held 1.887s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:46:59 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2" returned: 0 in 0.338s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-509754768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5903279-c57f-4d72-b882-245b6919a8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b5b667a99948a68891e2ee971d8d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:46:58Z,use_quota=True,user_id='b9cffad4b6504528baf26d15acaa71b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Creating volume c5903279-c57f-4d72-b882-245b6919a8e1 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:46:59 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:59 devstack cinder-volume[87597]: WARNING cinder.quota [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1687750554 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1687750554, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:46:59 devstack cinder-volume[87597]: WARNING cinder.quota [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1687750554 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1687750554, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74440bb1-fc5c-4d14-8ac8-ff70b5928a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae85058-e874-4a10-bd46-a15c4863f5c2', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:59 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 1073741824 Sep 09 03:46:59 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27425555-c435-4366-88a8-75b9aea3a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:59 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Volume volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 (4ae85058-e874-4a10-bd46-a15c4863f5c2): created successfully Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27425555-c435-4366-88a8-75b9aea3a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Flow 'volume_create_manager' (d0e73054-f6d9-4b30-a950-f8613ce86052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3ae2b89b-1184-4591-ba9a-99ec33f5eba5 tempest-VolumesListTestJSON-1888361728 None] Created volume successfully. Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['3a4be168-837b-47db-9b91-536d7205db06', '49692579-a238-43d9-a71a-30e9c7c96947', '67c66e18-a319-422c-9353-f57c6d8a9f28', '89195723-9515-466f-b668-f7c1a82962b0'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['c52a2b1d-52c2-43e1-a41e-aa61988b12f9', 'b99504ec-b537-4420-9963-15f75eb59e18', '25329d54-3dd7-4096-ab04-202bf1c0a3a5', '18b9ed0c-c262-450a-8d92-e50251d69217'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:46:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f991f328-a8be-46dc-8f3a-a3f68b3e6c98 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot 21fd5797-6fbc-4ebe-87e5-70ce3648b374: deleted successfully Sep 09 03:46:59 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 1073741824" returned: 0 in 0.508s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:46:59 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 Sep 09 03:46:59 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:46:59 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1" returned: 0 in 0.284s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca07a751-97e2-4400-8ac0-dbb98a518c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5903279-c57f-4d72-b882-245b6919a8e1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5526dd73-56e7-4cdd-adbd-06fa3f29a425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:46:59 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Volume volume-c5903279-c57f-4d72-b882-245b6919a8e1 (c5903279-c57f-4d72-b882-245b6919a8e1): created successfully Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5526dd73-56e7-4cdd-adbd-06fa3f29a425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:46:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Flow 'volume_create_manager' (461323cd-c26a-4ccb-938a-d9a2b4c50f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:46:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-627fda84-980d-4a63-adcd-3c0972ee4061 tempest-VolumesActionsTest-712279661 None] Created volume successfully. Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-5e5fddf5-e64c-4564-8e35-2afc86383314" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-5e5fddf5-e64c-4564-8e35-2afc86383314" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3cb83c-6509-49a6-97b3-d273b64f81c5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:00 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 Sep 09 03:47:00 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Flow 'volume_create_manager' (352b0a58-c8c7-43b8-8df2-0ffed331a7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0375c30d-b98e-4efb-bc28-c0688aee3cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0375c30d-b98e-4efb-bc28-c0688aee3cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-136055333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918d1319-d9c6-48d5-801f-013a6913b673,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f61973188ff8470dbc409be5ac543c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:01Z,use_quota=True,user_id='0c3362fce2554298abc8dc0aa81045ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329b0235-d411-4e57-91a1-3fb2b1ecfac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329b0235-d411-4e57-91a1-3fb2b1ecfac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caafb8d-9075-408e-85f4-960ca9ff2d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caafb8d-9075-408e-85f4-960ca9ff2d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918d1319-d9c6-48d5-801f-013a6913b673', 'volume_name': 'volume-918d1319-d9c6-48d5-801f-013a6913b673', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d1fbe6-52a8-485a-8156-d90b6f4682ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d1fbe6-52a8-485a-8156-d90b6f4682ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dede78b-2c55-4ebe-abed-92edb92e767d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:00 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Volume 918d1319-d9c6-48d5-801f-013a6913b673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918d1319-d9c6-48d5-801f-013a6913b673', 'volume_size': 1} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-136055333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918d1319-d9c6-48d5-801f-013a6913b673,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f61973188ff8470dbc409be5ac543c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:01Z,use_quota=True,user_id='0c3362fce2554298abc8dc0aa81045ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Creating volume 918d1319-d9c6-48d5-801f-013a6913b673 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:00 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:00 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314" returned: 0 in 0.462s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:00 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 1073741824 Sep 09 03:47:00 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:00 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314 Sep 09 03:47:00 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:01 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5e5fddf5-e64c-4564-8e35-2afc86383314" returned: 0 in 0.317s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-5e5fddf5-e64c-4564-8e35-2afc86383314" released by "delete_volume" :: held 0.881s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-66e34527-bcfc-41de-95b5-6072e50f93f7" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-66e34527-bcfc-41de-95b5-6072e50f93f7" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb81b14-f6c4-4915-b839-2956f59ae2dc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:01 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 1073741824" returned: 0 in 0.524s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:01 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 Sep 09 03:47:01 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:01 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 Sep 09 03:47:01 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:01 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:01 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7" returned: 0 in 0.612s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673" returned: 0 in 0.463s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dede78b-2c55-4ebe-abed-92edb92e767d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918d1319-d9c6-48d5-801f-013a6913b673', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da3663f-72de-4613-993b-c3ca6bb30004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:01 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7 Sep 09 03:47:01 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:01 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Volume volume-918d1319-d9c6-48d5-801f-013a6913b673 (918d1319-d9c6-48d5-801f-013a6913b673): created successfully Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da3663f-72de-4613-993b-c3ca6bb30004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Flow 'volume_create_manager' (352b0a58-c8c7-43b8-8df2-0ffed331a7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:01 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-89aa3323-2385-46e1-aa3c-88fcd57614bf tempest-VolumesListTestJSON-1888361728 None] Created volume successfully. Sep 09 03:47:02 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-66e34527-bcfc-41de-95b5-6072e50f93f7" returned: 0 in 0.369s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-66e34527-bcfc-41de-95b5-6072e50f93f7" released by "delete_volume" :: held 1.056s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Acquiring lock "cinder-c5903279-c57f-4d72-b882-245b6919a8e1-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Lock "cinder-c5903279-c57f-4d72-b882-245b6919a8e1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['edeccf9d-3e6b-4878-8629-19f5849d899f'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Acquiring lock "cinder-quobyte-c5903279-c57f-4d72-b882-245b6919a8e1" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Lock "cinder-quobyte-c5903279-c57f-4d72-b882-245b6919a8e1" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:02 devstack cinder-volume[87597]: WARNING cinder.quota [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1687750554 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1687750554, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f601674-f274-48fc-9b1d-f6b59f1b2655]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['557a6695-68c7-43f4-b1cc-461fd188a815', 'c82804bb-d257-4370-b0ab-232caa83919c', '5174e7c6-dd19-4eb7-9758-a6929f8201ad', 'ea4b8a8e-7f43-49d4-b2a9-896300f47369'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:02 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 Sep 09 03:47:02 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['04f16d56-c14c-428a-8263-7009cc9d9500', '5c4be362-2e59-4338-acfa-790367c64837', 'c7ab8410-341a-4121-92f3-038ec4f9fa42', 'c397a46b-2e56-4053-85ee-88bac93fcfe6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:02 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:02 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:02 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1" returned: 0 in 0.544s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:02 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1 Sep 09 03:47:02 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:03 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.437s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d0c8b7c1-d7ce-45f7-9a88-199027075839 tempest-GroupSnapshotsTest-1175724365 None] Delete group completed successfully. Sep 09 03:47:03 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5903279-c57f-4d72-b882-245b6919a8e1" returned: 0 in 0.524s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Lock "cinder-quobyte-c5903279-c57f-4d72-b882-245b6919a8e1" released by "delete_volume" :: held 1.133s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Created reservations ['7e36951c-4aca-41df-940a-00e53f98f57a', '14327288-a590-401b-b89c-058fb1c372f9', 'de817416-6a3b-46a1-be81-730cbb185ebc', 'a757a1e6-0cd8-41c0-9512-b0016ee604db'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:03 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:03 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2c92f622-e0d0-461f-a5a1-4165e59c993b tempest-GroupSnapshotsTest-1175724365 None] Group tempest-GroupSnapshotsTest-Group-1187178013: creating Sep 09 03:47:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2c92f622-e0d0-461f-a5a1-4165e59c993b tempest-GroupSnapshotsTest-1175724365 None] Group tempest-GroupSnapshotsTest-Group-1187178013: created successfully Sep 09 03:47:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2c92f622-e0d0-461f-a5a1-4165e59c993b tempest-GroupSnapshotsTest-1175724365 None] Create group completed successfully. Sep 09 03:47:03 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.297s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Deleted volume successfully. Sep 09 03:47:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f3fcddea-50ff-455a-a5b8-9eff93d62692 tempest-VolumesActionsTest-712279661 None] Lock "cinder-c5903279-c57f-4d72-b882-245b6919a8e1-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Flow 'volume_create_manager' (d15c9fe9-7192-4886-9cc7-a769ba9eb7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2c9609-05dd-4e13-930f-d6daaf76cc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2c9609-05dd-4e13-930f-d6daaf76cc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2107413339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deff42c-b19a-4ba7-9c32-8b8ff06fc223,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73801aa9d9da4a719c9e8abc54b57b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:04Z,use_quota=True,user_id='39443c27f1e942db85a1526a6fc5cb9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bea9c6-694d-4269-9168-a0d126da9b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bea9c6-694d-4269-9168-a0d126da9b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a487b5d9-fb94-4bc7-b309-61b2950c6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a487b5d9-fb94-4bc7-b309-61b2950c6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0deff42c-b19a-4ba7-9c32-8b8ff06fc223', 'volume_name': 'volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3936cf23-e319-4ee3-9ed4-ef9b01ca2f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3936cf23-e319-4ee3-9ed4-ef9b01ca2f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c65ee-5a6f-4626-bd9a-c0803da371ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:04 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Volume 0deff42c-b19a-4ba7-9c32-8b8ff06fc223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223', 'volume_size': 1} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2107413339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deff42c-b19a-4ba7-9c32-8b8ff06fc223,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73801aa9d9da4a719c9e8abc54b57b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:04Z,use_quota=True,user_id='39443c27f1e942db85a1526a6fc5cb9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Creating volume 0deff42c-b19a-4ba7-9c32-8b8ff06fc223 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:04 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:04 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 1073741824 Sep 09 03:47:04 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:04 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 1073741824" returned: 0 in 0.540s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:04 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 Sep 09 03:47:04 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:05 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223" returned: 0 in 0.340s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c65ee-5a6f-4626-bd9a-c0803da371ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a41942d-961b-4486-81f6-27b07d897596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:05 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Volume volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 (0deff42c-b19a-4ba7-9c32-8b8ff06fc223): created successfully Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a41942d-961b-4486-81f6-27b07d897596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Flow 'volume_create_manager' (d15c9fe9-7192-4886-9cc7-a769ba9eb7a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:05 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-46efd7dc-bedd-49cc-a405-40e548e3ebeb req-b63185c0-8272-4094-95e6-5dcb38008154 tempest-VolumesGetTestJSON-1628723828 None] Created volume successfully. Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "cinder-918d1319-d9c6-48d5-801f-013a6913b673-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-918d1319-d9c6-48d5-801f-013a6913b673-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Flow 'volume_create_manager' (6b762ea5-53bf-4134-861b-ffc4eeaf8715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0c93f1-6d73-4f4e-a939-d359ad93e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "cinder-quobyte-918d1319-d9c6-48d5-801f-013a6913b673" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0c93f1-6d73-4f4e-a939-d359ad93e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1811488240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f14f2b4-2022-48be-9100-2ff868b9e4d2,host='devstack@QuobyteHD#QuobyteHD',id=3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a222cbd362480a905e4927ffe680be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:06Z,use_quota=True,user_id='94173180af28483b9f09b2e06ca6e4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50b42c01-7551-4883-aafc-7e0ff3882afe),volume_type_id=50b42c01-7551-4883-aafc-7e0ff3882afe)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba19a2d-3390-475b-8db3-199ca925be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba19a2d-3390-475b-8db3-199ca925be67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132b3152-c314-4686-917e-2bae2615c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132b3152-c314-4686-917e-2bae2615c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58', 'volume_name': 'volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfc8d3a-0c54-43c9-9642-ce4f34dc734a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfc8d3a-0c54-43c9-9642-ce4f34dc734a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7ecd4b-b37b-41de-bd65-6de5a0c8e9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:05 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Volume 3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58', 'volume_size': 1} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f14f2b4-2022-48be-9100-2ff868b9e4d2,created_at=2026-09-09T01:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1811488240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f14f2b4-2022-48be-9100-2ff868b9e4d2,host='devstack@QuobyteHD#QuobyteHD',id=3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a222cbd362480a905e4927ffe680be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:06Z,use_quota=True,user_id='94173180af28483b9f09b2e06ca6e4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50b42c01-7551-4883-aafc-7e0ff3882afe),volume_type_id=50b42c01-7551-4883-aafc-7e0ff3882afe)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Creating volume 3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:05 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-quobyte-918d1319-d9c6-48d5-801f-013a6913b673" acquired by "delete_volume" :: waited 0.079s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:05 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 1073741824 Sep 09 03:47:05 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[756a4630-12f6-4cc0-b883-a21d68595892]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:05 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 Sep 09 03:47:05 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:06 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673" returned: 0 in 0.392s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:06 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 1073741824" returned: 0 in 0.466s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:06 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673 Sep 09 03:47:06 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:06 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 Sep 09 03:47:06 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:06 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-918d1319-d9c6-48d5-801f-013a6913b673" returned: 0 in 0.377s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:06 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-quobyte-918d1319-d9c6-48d5-801f-013a6913b673" released by "delete_volume" :: held 0.818s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7ecd4b-b37b-41de-bd65-6de5a0c8e9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c8f68a-40e1-4eb0-a145-f41451ad157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Acquiring lock "cinder-0deff42c-b19a-4ba7-9c32-8b8ff06fc223-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:06 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Volume volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 (3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58): created successfully Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c8f68a-40e1-4eb0-a145-f41451ad157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Flow 'volume_create_manager' (6b762ea5-53bf-4134-861b-ffc4eeaf8715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Lock "cinder-0deff42c-b19a-4ba7-9c32-8b8ff06fc223-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:06 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b25508bd-0fbd-4e43-9561-4a816cfe9c58 tempest-GroupSnapshotsTest-1175724365 None] Created volume successfully. Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Created reservations ['018655f9-3f01-4f89-887c-21cac3bb3113', 'e7a6ce3e-e1e0-4aa7-aaf9-3d98b747c3c4', '755e0c9e-dda4-41f4-8601-19d423e8451a', '36ddb0aa-fca9-4d4b-a503-994ebf9b3f90'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Acquiring lock "cinder-quobyte-0deff42c-b19a-4ba7-9c32-8b8ff06fc223" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Lock "cinder-quobyte-0deff42c-b19a-4ba7-9c32-8b8ff06fc223" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a504de-1685-44d4-80c4-bcd409a8dee3]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:06 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:06 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:07 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 Sep 09 03:47:07 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] GroupSnapshot b0078df1-9725-4258-a77b-ab5a33925285: creating. Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Group snapshot b0078df1-9725-4258-a77b-ab5a33925285: creating. {{(pid=87597) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:07 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Creating offline snapshot fb200cef-d103-4a9a-8e94-49f0dafda064 of volume 3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.356s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Deleted volume successfully. Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5eaccc-4dc4-4cb4-a837-b5498a878826]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-96455de9-4415-4ce0-8a7a-0eca41541dfc tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-918d1319-d9c6-48d5-801f-013a6913b673-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:07 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223" returned: 0 in 0.413s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:07 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223 Sep 09 03:47:07 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:07 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 Sep 09 03:47:07 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:07 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0deff42c-b19a-4ba7-9c32-8b8ff06fc223" returned: 0 in 0.301s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Lock "cinder-quobyte-0deff42c-b19a-4ba7-9c32-8b8ff06fc223" released by "delete_volume" :: held 0.782s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.quota [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Created reservations ['1cf3eda9-99d4-4118-a1f2-42caed21a86b', '9776c427-9365-41f2-b8a3-fcff5b3d6372', '9f45dbbb-bd85-4160-a149-e67d14878433', '8edfb9f8-1159-4099-9b5f-d29340557f9b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:07 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" returned: 0 in 0.438s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:07 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 1G Sep 09 03:47:07 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:07 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:07 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "cinder-4ae85058-e874-4a10-bd46-a15c4863f5c2-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-4ae85058-e874-4a10-bd46-a15c4863f5c2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "cinder-quobyte-4ae85058-e874-4a10-bd46-a15c4863f5c2" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-quobyte-4ae85058-e874-4a10-bd46-a15c4863f5c2" acquired by "delete_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad1d2c7-ec51-4e5e-82a1-423fbeda789c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:08 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.366s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG cinder.manager [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Deleted volume successfully. Sep 09 03:47:08 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 Sep 09 03:47:08 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-15cc8595-e264-473b-a3fd-b28146ec82f4 req-8246711f-1632-4a26-8664-7cd1a1859d8a tempest-VolumesGetTestJSON-1628723828 None] Lock "cinder-0deff42c-b19a-4ba7-9c32-8b8ff06fc223-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:08 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 1G" returned: 0 in 0.525s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:08 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 Sep 09 03:47:08 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:08 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2" returned: 0 in 0.455s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:08 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2 Sep 09 03:47:08 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:08 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064" returned: 0 in 0.487s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:08 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:08 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 Sep 09 03:47:08 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:08 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ae85058-e874-4a10-bd46-a15c4863f5c2" returned: 0 in 0.374s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-quobyte-4ae85058-e874-4a10-bd46-a15c4863f5c2" released by "delete_volume" :: held 0.886s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:08 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Created reservations ['56be8fc7-7002-47bf-8d01-0db67dd547f3', '83f0dd8e-9686-4e37-94f7-43dc1f788bc9', '4ceffcd6-397c-4bca-be43-1a7ca9a13bf5', '8902d3c1-d5a3-47bd-a52a-86ab35658fb3'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:09 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064" returned: 0 in 0.328s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:09 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.info Sep 09 03:47:09 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:09 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:09 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "cinder-93073098-e6de-4e73-acea-b9e29867bc84-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-93073098-e6de-4e73-acea-b9e29867bc84-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "cinder-quobyte-93073098-e6de-4e73-acea-b9e29867bc84" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-quobyte-93073098-e6de-4e73-acea-b9e29867bc84" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[35468dcf-593c-476a-afaa-74b7191633f0]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:09 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.info" returned: 0 in 0.382s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:09 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:09 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.info Sep 09 03:47:09 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:09 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.426s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:09 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:09 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Deleted volume successfully. Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8dcfb00a-9ed3-44c8-a811-bd41e60ef029 tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-4ae85058-e874-4a10-bd46-a15c4863f5c2-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:09 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.info" returned: 0 in 0.374s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:09 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84" returned: 0 in 0.536s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:10 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84 Sep 09 03:47:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fb8813b0-d076-4e3a-b21d-bbacc1056b19 tempest-GroupSnapshotsTest-1175724365 None] group_snapshot b0078df1-9725-4258-a77b-ab5a33925285: created successfully Sep 09 03:47:10 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:10 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93073098-e6de-4e73-acea-b9e29867bc84" returned: 0 in 0.291s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-quobyte-93073098-e6de-4e73-acea-b9e29867bc84" released by "delete_volume" :: held 0.889s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Created reservations ['717608cc-71fc-4f05-825e-65135ce3aad3', '3cd709ea-397e-42b0-9ae7-cd6598df7393', 'fade25f2-a31c-475c-862a-443d2286a57a', '401dbdfa-4216-478e-bf47-ec6936f759b6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:10 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:10 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] group_snapshot b0078df1-9725-4258-a77b-ab5a33925285: deleting Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] group_snapshot b0078df1-9725-4258-a77b-ab5a33925285: deleting {{(pid=87597) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-fb200cef-d103-4a9a-8e94-49f0dafda064" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-fb200cef-d103-4a9a-8e94-49f0dafda064" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Deleting offline snapshot fb200cef-d103-4a9a-8e94-49f0dafda064 of volume 3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] snapshot_file for this snap is: volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6250dd5a-b531-4164-ae63-afe19aa602f7]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:10 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.426s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Deleted volume successfully. Sep 09 03:47:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5cd52bd7-778b-4266-8e3c-cc44330568ee tempest-VolumesListTestJSON-1888361728 None] Lock "cinder-93073098-e6de-4e73-acea-b9e29867bc84-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:11 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 Sep 09 03:47:11 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:11 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064" returned: 0 in 0.551s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:47:11 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[460697ca-06df-4f1e-89a0-dcdd65b3a929]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:11 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 Sep 09 03:47:11 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:11 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" returned: 0 in 0.495s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:12 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 Sep 09 03:47:12 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:12 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064" returned: 0 in 0.465s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:12 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064 Sep 09 03:47:12 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:12 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58.fb200cef-d103-4a9a-8e94-49f0dafda064" returned: 0 in 0.330s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-fb200cef-d103-4a9a-8e94-49f0dafda064" released by "_delete_snapshot" :: held 1.987s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" released by "delete_snapshot" :: held 2.013s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:12 devstack cinder-volume[87597]: WARNING cinder.quota [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2064813030 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2064813030, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:47:12 devstack cinder-volume[87597]: WARNING cinder.quota [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2064813030 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2064813030, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:47:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['ee6a15a8-b151-456a-a7ef-e284dcd6a06f', '8d6cb4bc-0b81-4b4c-b0c2-f93842d08cb4', 'e0de438f-374e-409a-80d6-03f74e4ad369', '91b905f8-0d1e-4259-88a5-7b43268b8054'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6819c301-3c13-4f8c-8297-143843875c3d tempest-GroupSnapshotsTest-1175724365 None] group_snapshot b0078df1-9725-4258-a77b-ab5a33925285: deleted successfully Sep 09 03:47:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "cinder-quobyte-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" acquired by "delete_volume" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7636aec-adfe-4369-9f37-7110a872a36d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:13 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 Sep 09 03:47:13 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:14 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" returned: 0 in 0.433s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:14 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58 Sep 09 03:47:14 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:14 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Lock "cinder-quobyte-3bda81ce-bdf8-4934-8efe-6b5fbc4ebb58" released by "delete_volume" :: held 0.812s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['c0cf8e2e-1196-40ef-9c24-9dbfeae76bb0'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-52499d0d-f4f6-4ae5-9f32-fb34b06a1975 tempest-GroupsTest-1601970085 None] Group tempest-Group1-732513678: creating Sep 09 03:47:14 devstack cinder-volume[87597]: WARNING cinder.quota [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2064813030 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2064813030, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:47:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-52499d0d-f4f6-4ae5-9f32-fb34b06a1975 tempest-GroupsTest-1601970085 None] Group tempest-Group1-732513678: created successfully Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Created reservations ['80084d81-1c47-45f0-ad8b-be1c8ba0b614', 'db9b96d3-c908-4937-910a-ebb1ecef580e', 'e7a69af1-ddf0-482d-b655-2d262dac0c35', 'b4cb79ab-9d27-4a86-ba1a-517008fbe27a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-52499d0d-f4f6-4ae5-9f32-fb34b06a1975 tempest-GroupsTest-1601970085 None] Create group completed successfully. Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:14 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:14 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:14 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.270s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:14 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4b778012-7dae-4179-acb1-d8ef64108a7f tempest-GroupSnapshotsTest-1175724365 None] Delete group completed successfully. Sep 09 03:47:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a7b8aa59-9b28-44bd-9792-f6eb5d6353c8 tempest-GroupsTest-1601970085 None] Group tempest-Group2-643208483: creating Sep 09 03:47:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a7b8aa59-9b28-44bd-9792-f6eb5d6353c8 tempest-GroupsTest-1601970085 None] Group tempest-Group2-643208483: created successfully Sep 09 03:47:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a7b8aa59-9b28-44bd-9792-f6eb5d6353c8 tempest-GroupsTest-1601970085 None] Create group completed successfully. Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Flow 'volume_create_manager' (f551ef30-598d-4137-a5a2-d20dc2420950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a784a968-8197-44d7-954b-8e1521f08bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a784a968-8197-44d7-954b-8e1521f08bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1825897645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=700f320a-9d20-4293-b11b-60636d3f8c19,host='devstack@QuobyteHD#QuobyteHD',id=620f2017-9ba0-4d4e-89d1-038d362156b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e3f0e78c084403aaa71b4493eb9c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:18Z,use_quota=True,user_id='845f1dba63bf4d71b3bdf681ea2b209f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08ad816c-0a7d-4a55-b43d-4e0906122713),volume_type_id=08ad816c-0a7d-4a55-b43d-4e0906122713)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95777a5f-44e8-47c6-aaff-0c5952aef132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95777a5f-44e8-47c6-aaff-0c5952aef132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eeb255f-dfe2-4fa5-a1f1-3aa1a23771e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eeb255f-dfe2-4fa5-a1f1-3aa1a23771e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620f2017-9ba0-4d4e-89d1-038d362156b4', 'volume_name': 'volume-620f2017-9ba0-4d4e-89d1-038d362156b4', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c127fcf-7a0f-488f-8460-90d699ddcb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c127fcf-7a0f-488f-8460-90d699ddcb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f446aac5-2947-489c-9207-85002cb5bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:17 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Volume 620f2017-9ba0-4d4e-89d1-038d362156b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620f2017-9ba0-4d4e-89d1-038d362156b4', 'volume_size': 1} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=700f320a-9d20-4293-b11b-60636d3f8c19,created_at=2026-09-09T01:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1825897645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=700f320a-9d20-4293-b11b-60636d3f8c19,host='devstack@QuobyteHD#QuobyteHD',id=620f2017-9ba0-4d4e-89d1-038d362156b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e3f0e78c084403aaa71b4493eb9c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:18Z,use_quota=True,user_id='845f1dba63bf4d71b3bdf681ea2b209f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08ad816c-0a7d-4a55-b43d-4e0906122713),volume_type_id=08ad816c-0a7d-4a55-b43d-4e0906122713)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Creating volume 620f2017-9ba0-4d4e-89d1-038d362156b4 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:17 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:17 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 1073741824 Sep 09 03:47:17 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:18 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 1073741824" returned: 0 in 0.606s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:18 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 Sep 09 03:47:18 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:18 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4" returned: 0 in 0.327s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f446aac5-2947-489c-9207-85002cb5bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620f2017-9ba0-4d4e-89d1-038d362156b4', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279a59d2-b649-42be-8a92-402266f7b900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:18 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Volume volume-620f2017-9ba0-4d4e-89d1-038d362156b4 (620f2017-9ba0-4d4e-89d1-038d362156b4): created successfully Sep 09 03:47:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279a59d2-b649-42be-8a92-402266f7b900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Flow 'volume_create_manager' (f551ef30-598d-4137-a5a2-d20dc2420950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f1a21a03-42c0-4e8f-a0ee-568c4a2c410b tempest-GroupsTest-1601970085 None] Created volume successfully. Sep 09 03:47:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Acquiring lock "cinder-quobyte-620f2017-9ba0-4d4e-89d1-038d362156b4" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Lock "cinder-quobyte-620f2017-9ba0-4d4e-89d1-038d362156b4" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:21 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b724a41-31f4-41ea-b547-2ef467568c32]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:21 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 Sep 09 03:47:21 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:21 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4" returned: 0 in 0.650s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:21 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4 Sep 09 03:47:21 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:22 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-620f2017-9ba0-4d4e-89d1-038d362156b4" returned: 0 in 0.386s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Lock "cinder-quobyte-620f2017-9ba0-4d4e-89d1-038d362156b4" released by "delete_volume" :: held 1.097s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Created reservations ['6acfb11e-f42a-4e2d-b52e-7207a1912640'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:22 devstack cinder-volume[87597]: WARNING cinder.quota [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-381849802 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-381849802, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:47:22 devstack cinder-volume[87597]: WARNING cinder.quota [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-381849802 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-381849802, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Created reservations ['d195818f-30c5-4f68-9cb0-61f3e1288b3d', '99eb7370-1900-49bb-b841-4bb2dd5fc792', '67a4213c-dc1e-4c9c-ab24-e1b170d2f376', '1b58b9ec-7c69-4359-b495-ffd4e7c7713f'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:22 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:22 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Created reservations ['8f625b8f-3bda-43f5-8b8c-d2434c2a9a25'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:22 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.394s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:22 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:22 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2beb2722-a91d-4f93-a21c-6fad5930b90a tempest-GroupsTest-1601970085 None] Delete group completed successfully. Sep 09 03:47:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:23 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:23 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:23 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.339s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:23 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:23 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3304f2b2-1970-4faa-84e3-2b3ca7308091 tempest-GroupsTest-1601970085 None] Delete group completed successfully. Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Flow 'volume_create_manager' (862f815e-fbcd-4fc7-b29b-3ea96342add5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175a34d5-3706-480c-807e-66ca950cd675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175a34d5-3706-480c-807e-66ca950cd675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-930489441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e8ab99-2f2a-41e7-9102-0c0180d9ec12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5571d147b9454393ad777c174cfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:25Z,use_quota=True,user_id='ed0ce975aa6b48a780f582b6688ea26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d67e159-f2a8-4f36-b95d-95ca19e224b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d67e159-f2a8-4f36-b95d-95ca19e224b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5755c94c-2d94-4e07-87d7-2bb20b60cbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5755c94c-2d94-4e07-87d7-2bb20b60cbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e8ab99-2f2a-41e7-9102-0c0180d9ec12', 'volume_name': 'volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb46380d-1aab-4ed1-9863-ef7b46d93634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb46380d-1aab-4ed1-9863-ef7b46d93634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a40556-7d3b-43bb-9810-e3711237df37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:24 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Volume 40e8ab99-2f2a-41e7-9102-0c0180d9ec12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12', 'volume_size': 1} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-930489441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e8ab99-2f2a-41e7-9102-0c0180d9ec12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5571d147b9454393ad777c174cfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:25Z,use_quota=True,user_id='ed0ce975aa6b48a780f582b6688ea26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Creating volume 40e8ab99-2f2a-41e7-9102-0c0180d9ec12 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:24 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:24 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 1073741824 Sep 09 03:47:24 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:24 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-40f10724-4b79-45bc-928b-21bd863debb7 tempest-GroupsTest-1601970085 None] Group tempest-GroupsTest-Group-1764836196: creating Sep 09 03:47:24 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-40f10724-4b79-45bc-928b-21bd863debb7 tempest-GroupsTest-1601970085 None] Group tempest-GroupsTest-Group-1764836196: created successfully Sep 09 03:47:24 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-40f10724-4b79-45bc-928b-21bd863debb7 tempest-GroupsTest-1601970085 None] Create group completed successfully. Sep 09 03:47:25 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 1073741824" returned: 0 in 0.501s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:25 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 Sep 09 03:47:25 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:25 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12" returned: 0 in 0.315s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a40556-7d3b-43bb-9810-e3711237df37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a7ec16-fa21-470a-bd80-8d1e70cc58fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:25 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Volume volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 (40e8ab99-2f2a-41e7-9102-0c0180d9ec12): created successfully Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a7ec16-fa21-470a-bd80-8d1e70cc58fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Flow 'volume_create_manager' (862f815e-fbcd-4fc7-b29b-3ea96342add5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:25 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-407b6410-0b52-45c1-bac1-ad54feda6ddf tempest-VolumesListAdminTestJSON-1941565836 None] Created volume successfully. Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Flow 'volume_create_manager' (605625e9-8a9a-4957-9a2d-90b5c1dca762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab40d672-6ce3-431e-a14a-701c641de5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab40d672-6ce3-431e-a14a-701c641de5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451722901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72ee5878-2af9-476f-b2d2-4253605fb9fb,host='devstack@QuobyteHD#QuobyteHD',id=de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e3f0e78c084403aaa71b4493eb9c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:27Z,use_quota=True,user_id='845f1dba63bf4d71b3bdf681ea2b209f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(598dcbec-5e5a-48e5-aa5b-c1e5098b1a44),volume_type_id=598dcbec-5e5a-48e5-aa5b-c1e5098b1a44)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9418a0-202c-4444-87fe-a3ed54a2a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9418a0-202c-4444-87fe-a3ed54a2a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd8954c-6d66-44dc-b597-fa70755675ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd8954c-6d66-44dc-b597-fa70755675ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4', 'volume_name': 'volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9d3e37-ddec-4433-a5a1-be0061db6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9d3e37-ddec-4433-a5a1-be0061db6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0e0677-f174-4f46-bfcc-1dd19ede315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:26 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Volume de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4', 'volume_size': 1} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72ee5878-2af9-476f-b2d2-4253605fb9fb,created_at=2026-09-09T01:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451722901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72ee5878-2af9-476f-b2d2-4253605fb9fb,host='devstack@QuobyteHD#QuobyteHD',id=de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e3f0e78c084403aaa71b4493eb9c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:27Z,use_quota=True,user_id='845f1dba63bf4d71b3bdf681ea2b209f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(598dcbec-5e5a-48e5-aa5b-c1e5098b1a44),volume_type_id=598dcbec-5e5a-48e5-aa5b-c1e5098b1a44)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Creating volume de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:26 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:26 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 1073741824 Sep 09 03:47:26 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:27 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 1073741824" returned: 0 in 0.672s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Flow 'volume_create_manager' (54e9b230-356b-4ea9-8f6d-adb35fb6eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194514b5-bb9f-4b52-9deb-1098226bc6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194514b5-bb9f-4b52-9deb-1098226bc6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1484074975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d4c0b2-de7e-4f20-a336-e92f2bd32745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5571d147b9454393ad777c174cfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:28Z,use_quota=True,user_id='ed0ce975aa6b48a780f582b6688ea26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6528a9f8-ff00-42a2-91d2-7b2f267c7227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6528a9f8-ff00-42a2-91d2-7b2f267c7227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0865f7-b566-46db-ae31-4dedf20e9383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0865f7-b566-46db-ae31-4dedf20e9383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d4c0b2-de7e-4f20-a336-e92f2bd32745', 'volume_name': 'volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5208b4-59c4-4219-b80e-a172f5d76347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5208b4-59c4-4219-b80e-a172f5d76347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14b88ef-f0f5-4eaa-bf97-a05ca4d4fd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:27 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Volume 99d4c0b2-de7e-4f20-a336-e92f2bd32745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745', 'volume_size': 1} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:27 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 Sep 09 03:47:27 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:28 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4" returned: 0 in 0.344s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1484074975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d4c0b2-de7e-4f20-a336-e92f2bd32745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5571d147b9454393ad777c174cfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:28Z,use_quota=True,user_id='ed0ce975aa6b48a780f582b6688ea26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Creating volume 99d4c0b2-de7e-4f20-a336-e92f2bd32745 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:28 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0e0677-f174-4f46-bfcc-1dd19ede315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472e94ef-f3e0-48df-89d2-e260f39e3211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:28 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 1073741824 Sep 09 03:47:28 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:28 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Volume volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 (de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4): created successfully Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472e94ef-f3e0-48df-89d2-e260f39e3211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Flow 'volume_create_manager' (605625e9-8a9a-4957-9a2d-90b5c1dca762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:28 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a2589088-0490-40e2-b73e-4065f291b1d1 tempest-GroupsTest-1601970085 None] Created volume successfully. Sep 09 03:47:28 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 1073741824" returned: 0 in 0.562s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:28 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 Sep 09 03:47:28 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:29 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745" returned: 0 in 0.278s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14b88ef-f0f5-4eaa-bf97-a05ca4d4fd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab766e82-dd28-4ed4-8890-b51d709394bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:29 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Volume volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 (99d4c0b2-de7e-4f20-a336-e92f2bd32745): created successfully Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab766e82-dd28-4ed4-8890-b51d709394bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Flow 'volume_create_manager' (54e9b230-356b-4ea9-8f6d-adb35fb6eecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:29 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c94715e9-591f-4afb-b2ee-33a9338879ed tempest-VolumesListAdminTestJSON-1941565836 None] Created volume successfully. Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Flow 'volume_create_manager' (4b4844a1-9045-4223-b8e9-798315ca2def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec481df2-de7a-487b-b1ff-eb69128e5e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec481df2-de7a-487b-b1ff-eb69128e5e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906762610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72ee5878-2af9-476f-b2d2-4253605fb9fb,host='devstack@QuobyteHD#QuobyteHD',id=5806e996-52e8-44ef-8f33-10f216869f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e3f0e78c084403aaa71b4493eb9c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:30Z,use_quota=True,user_id='845f1dba63bf4d71b3bdf681ea2b209f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(598dcbec-5e5a-48e5-aa5b-c1e5098b1a44),volume_type_id=598dcbec-5e5a-48e5-aa5b-c1e5098b1a44)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb63631-7ec7-4260-9828-7afe883b4b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb63631-7ec7-4260-9828-7afe883b4b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ef80d6-b194-43be-b4d8-3007b2faaf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ef80d6-b194-43be-b4d8-3007b2faaf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5806e996-52e8-44ef-8f33-10f216869f9e', 'volume_name': 'volume-5806e996-52e8-44ef-8f33-10f216869f9e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a45ba5-9126-4704-b55b-014ee96ed583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a45ba5-9126-4704-b55b-014ee96ed583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494c4b18-9f93-4eb4-b788-b5e9796bc492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Volume 5806e996-52e8-44ef-8f33-10f216869f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5806e996-52e8-44ef-8f33-10f216869f9e', 'volume_size': 1} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72ee5878-2af9-476f-b2d2-4253605fb9fb,created_at=2026-09-09T01:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906762610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72ee5878-2af9-476f-b2d2-4253605fb9fb,host='devstack@QuobyteHD#QuobyteHD',id=5806e996-52e8-44ef-8f33-10f216869f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e3f0e78c084403aaa71b4493eb9c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:30Z,use_quota=True,user_id='845f1dba63bf4d71b3bdf681ea2b209f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(598dcbec-5e5a-48e5-aa5b-c1e5098b1a44),volume_type_id=598dcbec-5e5a-48e5-aa5b-c1e5098b1a44)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Creating volume 5806e996-52e8-44ef-8f33-10f216869f9e {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:30 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:30 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e 1073741824 Sep 09 03:47:30 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Flow 'volume_create_manager' (d367f05d-6f4a-4f7c-a163-ac4d03cf11e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42195122-aa0a-4a43-96c3-e5847f666ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42195122-aa0a-4a43-96c3-e5847f666ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253950976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e6b9e1-84d6-4a0a-919f-659f709d66f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5571d147b9454393ad777c174cfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:30Z,use_quota=True,user_id='ed0ce975aa6b48a780f582b6688ea26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b701c29-908b-44d1-a802-e39db6c89361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b701c29-908b-44d1-a802-e39db6c89361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f10c0ca-c4eb-4439-b341-3b722e471edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f10c0ca-c4eb-4439-b341-3b722e471edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e6b9e1-84d6-4a0a-919f-659f709d66f5', 'volume_name': 'volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd2a4ac-299a-4b73-b060-b974158ba83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd2a4ac-299a-4b73-b060-b974158ba83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c4bb28-08bd-435a-8073-20f85d7d13c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Volume e6e6b9e1-84d6-4a0a-919f-659f709d66f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5', 'volume_size': 1} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:30 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e 1073741824" returned: 0 in 0.519s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:30 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e Sep 09 03:47:30 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:30 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e" returned: 0 in 0.284s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253950976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e6b9e1-84d6-4a0a-919f-659f709d66f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5571d147b9454393ad777c174cfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:30Z,use_quota=True,user_id='ed0ce975aa6b48a780f582b6688ea26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Creating volume e6e6b9e1-84d6-4a0a-919f-659f709d66f5 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:30 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494c4b18-9f93-4eb4-b788-b5e9796bc492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5806e996-52e8-44ef-8f33-10f216869f9e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:30 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35456350-f850-4dd4-ba92-ebe567438230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:30 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 1073741824 Sep 09 03:47:30 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:31 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Volume volume-5806e996-52e8-44ef-8f33-10f216869f9e (5806e996-52e8-44ef-8f33-10f216869f9e): created successfully Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35456350-f850-4dd4-ba92-ebe567438230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Flow 'volume_create_manager' (4b4844a1-9045-4223-b8e9-798315ca2def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d3f9a464-089a-410a-9a7a-0b7499aaac22 tempest-GroupsTest-1601970085 None] Created volume successfully. Sep 09 03:47:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ae7540b2-b201-4287-9199-afb3f2f6a632 tempest-GroupsTest-1601970085 None] Update group completed successfully. Sep 09 03:47:31 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 1073741824" returned: 0 in 0.596s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:31 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 Sep 09 03:47:31 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:31 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5" returned: 0 in 0.294s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=192,cinder:INSERT=52,cinder:UPDATE=246,cinder:DELETE=12 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:47:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-55307b05-e9d4-4641-a53a-85ebe52daad3 tempest-GroupsV320Test-1790092473 None] Group tempest-GroupsV320Test-Group-1327046347: creating Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c4bb28-08bd-435a-8073-20f85d7d13c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098823c1-1dcb-460c-99eb-419e1a26c9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:31 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Volume volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 (e6e6b9e1-84d6-4a0a-919f-659f709d66f5): created successfully Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098823c1-1dcb-460c-99eb-419e1a26c9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Flow 'volume_create_manager' (d367f05d-6f4a-4f7c-a163-ac4d03cf11e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4f5a2eb8-9640-4b54-857b-884a4bf2ac1e tempest-VolumesListAdminTestJSON-1941565836 None] Created volume successfully. Sep 09 03:47:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-55307b05-e9d4-4641-a53a-85ebe52daad3 tempest-GroupsV320Test-1790092473 None] Group tempest-GroupsV320Test-Group-1327046347: created successfully Sep 09 03:47:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-55307b05-e9d4-4641-a53a-85ebe52daad3 tempest-GroupsV320Test-1790092473 None] Create group completed successfully. Sep 09 03:47:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fe27f04a-5761-431d-9124-1facaf20a020 tempest-GroupsTest-1601970085 None] Update group completed successfully. Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Flow 'volume_create_manager' (d2b116a4-bae9-4333-ae43-0c4b459e12a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298c8ebb-adc2-4a03-a227-cee7ac7c76c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298c8ebb-adc2-4a03-a227-cee7ac7c76c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50c2fe2-9fa3-408e-91a7-c255350e658f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e9c298355346e5b62a27947a04462c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:33Z,use_quota=True,user_id='e1836f1905074057947cebecb428b9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a803450-ccce-4aea-af3c-ad7fad14449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a803450-ccce-4aea-af3c-ad7fad14449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e01350-e3dd-4676-bbd7-f1c1fdb955e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e01350-e3dd-4676-bbd7-f1c1fdb955e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50c2fe2-9fa3-408e-91a7-c255350e658f', 'volume_name': 'volume-f50c2fe2-9fa3-408e-91a7-c255350e658f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46a19b7-7a32-47f3-872d-5f1479918f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46a19b7-7a32-47f3-872d-5f1479918f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d154cc7a-3956-4338-b78d-f251dcc31c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:33 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Volume f50c2fe2-9fa3-408e-91a7-c255350e658f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50c2fe2-9fa3-408e-91a7-c255350e658f', 'volume_size': 1} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50c2fe2-9fa3-408e-91a7-c255350e658f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e9c298355346e5b62a27947a04462c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:33Z,use_quota=True,user_id='e1836f1905074057947cebecb428b9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Creating volume f50c2fe2-9fa3-408e-91a7-c255350e658f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:33 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:33 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f 1073741824 Sep 09 03:47:33 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Created reservations ['e8abdedf-9db1-4797-b3df-92bb85b51461'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:33 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:33 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:34 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f 1073741824" returned: 0 in 0.752s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:34 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.385s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:34 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0b53a9a4-7db5-4c4c-b723-f383348801bf tempest-GroupsV320Test-1790092473 None] Delete group completed successfully. Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:34 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f Sep 09 03:47:34 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:34 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f" returned: 0 in 0.305s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d154cc7a-3956-4338-b78d-f251dcc31c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50c2fe2-9fa3-408e-91a7-c255350e658f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1840a1-25fe-4906-a5ae-b2c867faf7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:34 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Volume volume-f50c2fe2-9fa3-408e-91a7-c255350e658f (f50c2fe2-9fa3-408e-91a7-c255350e658f): created successfully Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1840a1-25fe-4906-a5ae-b2c867faf7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Flow 'volume_create_manager' (d2b116a4-bae9-4333-ae43-0c4b459e12a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:34 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-79bef039-e9d7-4cdb-81ad-5ca8c70bf3b3 tempest-VolumesListAdminTestJSON-1640727486 None] Created volume successfully. Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Acquiring lock "cinder-quobyte-5806e996-52e8-44ef-8f33-10f216869f9e" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Lock "cinder-quobyte-5806e996-52e8-44ef-8f33-10f216869f9e" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bd05ff-8499-42cf-9d93-ca14b0ec67b8]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:34 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e Sep 09 03:47:34 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:35 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e" returned: 0 in 0.444s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:35 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e Sep 09 03:47:35 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Acquiring lock "cinder-f50c2fe2-9fa3-408e-91a7-c255350e658f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Lock "cinder-f50c2fe2-9fa3-408e-91a7-c255350e658f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:35 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5806e996-52e8-44ef-8f33-10f216869f9e" returned: 0 in 0.374s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Lock "cinder-quobyte-5806e996-52e8-44ef-8f33-10f216869f9e" released by "delete_volume" :: held 0.885s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Acquiring lock "cinder-quobyte-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Lock "cinder-quobyte-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Acquiring lock "cinder-quobyte-f50c2fe2-9fa3-408e-91a7-c255350e658f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1178692d-c5b4-4f9d-bdcd-f30f300e0bf5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Lock "cinder-quobyte-f50c2fe2-9fa3-408e-91a7-c255350e658f" acquired by "delete_volume" :: waited 0.046s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "cinder-e6e6b9e1-84d6-4a0a-919f-659f709d66f5-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687ab72-47ee-40c0-b8f5-d00da3e9fba7]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-e6e6b9e1-84d6-4a0a-919f-659f709d66f5-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:35 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "cinder-quobyte-e6e6b9e1-84d6-4a0a-919f-659f709d66f5" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:35 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-quobyte-e6e6b9e1-84d6-4a0a-919f-659f709d66f5" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4298e612-55d8-4790-bb63-945c1cfb9081]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:35 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f Sep 09 03:47:35 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:36 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 Sep 09 03:47:36 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:36 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4" returned: 0 in 0.547s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:36 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4 Sep 09 03:47:36 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:36 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f" returned: 0 in 0.701s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:36 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f Sep 09 03:47:36 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:36 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5" returned: 0 in 0.652s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:36 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5 Sep 09 03:47:36 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:36 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4" returned: 0 in 0.481s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Lock "cinder-quobyte-de9b3ebe-a52a-48b2-b06b-0b70ccf95fe4" released by "delete_volume" :: held 1.117s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Created reservations ['d0af9646-04e1-4e1f-a4a7-09a4ef28ed5b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:36 devstack cinder-volume[87597]: WARNING cinder.quota [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1086308681 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1086308681, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:47:36 devstack cinder-volume[87597]: WARNING cinder.quota [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1086308681 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1086308681, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:47:36 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Created reservations ['202da36e-faf9-460f-ad5b-8b2b11a815a4', '8dcdcc8c-6bc4-423c-985e-63e060ba7ca4', 'dacb2d3c-e4fc-4048-bd6d-e948826f7516', 'aea36516-083c-4811-ac14-9b5251731311'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:37 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f50c2fe2-9fa3-408e-91a7-c255350e658f" returned: 0 in 0.655s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:37 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e6e6b9e1-84d6-4a0a-919f-659f709d66f5" returned: 0 in 0.542s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Lock "cinder-quobyte-f50c2fe2-9fa3-408e-91a7-c255350e658f" released by "delete_volume" :: held 1.445s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-quobyte-e6e6b9e1-84d6-4a0a-919f-659f709d66f5" released by "delete_volume" :: held 1.291s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Created reservations ['443360b8-a2eb-4c26-ba13-407e8ab1d13b', 'cbcbcfc8-4399-42ea-b0a7-8d88342b2254', '8eb5fb30-9340-4bf9-b7a9-b39d996e6aee', '450eb2c2-a08b-4314-be16-1d0b24ba243d'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Created reservations ['824b7575-6a9e-4f80-9306-54d0634052df', 'c76eccee-2e7f-42cc-9517-0bb8b28f8ccd', 'afc16d9a-4712-479c-b8cc-3b02a75202a8', '37c713d9-4dac-4db2-afdb-f5e7883d3323'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Created reservations ['50b51cfb-9881-46ed-8218-050f3994e3f6', 'ff96cba6-c8dc-4779-acd0-947d967f5115', 'f316bb27-d79d-442c-8ef7-30e092fc8c7f', '6a815813-54b6-4e0c-9fe1-60d39fa74cd8'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:37 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:37 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:37 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:37 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:37 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:37 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:37 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:37 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:37 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:37 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.414s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Deleted volume successfully. Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.405s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0ac82569-4b8a-40a4-a94b-6d55cbf6404c tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-e6e6b9e1-84d6-4a0a-919f-659f709d66f5-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:37 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.433s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Deleted volume successfully. Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-faec7a0d-c128-472c-a441-6500ac811dec tempest-VolumesListAdminTestJSON-1640727486 None] Lock "cinder-f50c2fe2-9fa3-408e-91a7-c255350e658f-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:37 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.376s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-faa871b5-86fe-4436-a928-61ad73926283 tempest-GroupsTest-1601970085 None] Delete group completed successfully. Sep 09 03:47:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "cinder-99d4c0b2-de7e-4f20-a336-e92f2bd32745-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-99d4c0b2-de7e-4f20-a336-e92f2bd32745-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "cinder-quobyte-99d4c0b2-de7e-4f20-a336-e92f2bd32745" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-quobyte-99d4c0b2-de7e-4f20-a336-e92f2bd32745" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:38 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0ec1c-5138-4a8a-9237-57ccf31a8598]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:38 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 Sep 09 03:47:38 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:38 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745" returned: 0 in 0.501s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:38 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745 Sep 09 03:47:38 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:39 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-99d4c0b2-de7e-4f20-a336-e92f2bd32745" returned: 0 in 0.356s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-quobyte-99d4c0b2-de7e-4f20-a336-e92f2bd32745" released by "delete_volume" :: held 0.911s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=264,cinder:DELETE=21,cinder:SELECT=212,cinder:INSERT=61 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Created reservations ['37a00dcf-fd89-4afa-a84f-28142bdcf886', 'bbc09dc1-54e7-40cc-9dc6-d4e5db43dc80', 'bcd2b96e-e400-4c45-8f7f-1f4b848387ad', 'c245c108-022d-4564-bcc0-39635ff8e865'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:39 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:39 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:39 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Deleted volume successfully. Sep 09 03:47:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9f2a6898-e0ae-4414-b32f-904b88847d7a tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-99d4c0b2-de7e-4f20-a336-e92f2bd32745-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "cinder-40e8ab99-2f2a-41e7-9102-0c0180d9ec12-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-40e8ab99-2f2a-41e7-9102-0c0180d9ec12-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "cinder-quobyte-40e8ab99-2f2a-41e7-9102-0c0180d9ec12" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-quobyte-40e8ab99-2f2a-41e7-9102-0c0180d9ec12" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b866eb8-0560-423d-bcea-8a932b2c54aa]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:40 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 Sep 09 03:47:40 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:41 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12" returned: 0 in 0.568s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:41 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12 Sep 09 03:47:41 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:41 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-40e8ab99-2f2a-41e7-9102-0c0180d9ec12" returned: 0 in 0.301s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-quobyte-40e8ab99-2f2a-41e7-9102-0c0180d9ec12" released by "delete_volume" :: held 0.934s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Created reservations ['41b9311b-3a25-4729-878a-3fa657b6d5e2', 'b0cd141f-8517-408d-898c-1abef80a2490', '27e95c79-72b9-42dc-9d8d-fa314fd1fac1', '24157d95-ebcf-429d-b1c3-743b78be3151'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:41 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:47:41 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:42 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.272s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:42 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:47:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Deleted volume successfully. Sep 09 03:47:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ca13b82b-1241-47c6-a906-43df95e6c8a0 tempest-VolumesListAdminTestJSON-1941565836 None] Lock "cinder-40e8ab99-2f2a-41e7-9102-0c0180d9ec12-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Flow 'volume_create_manager' (2c15ad5c-bcef-462e-b9fb-97320b1c5666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0370f92f-f39c-41ef-8bc1-8da6801d6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0370f92f-f39c-41ef-8bc1-8da6801d6e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1408710262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8a9819-683a-42b2-a26c-9db8ee305994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49deea3bec54cdbb4c1e56ff64069ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:47Z,use_quota=True,user_id='3999c158dfd54e7c93ac1f513bde4cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61485327-0be5-4ac9-a9e3-404010c7e4e8),volume_type_id=61485327-0be5-4ac9-a9e3-404010c7e4e8)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247c9790-d7df-4f70-87e7-47750a1ad819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247c9790-d7df-4f70-87e7-47750a1ad819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61070b7-91d6-4122-8ace-1fd7ae633154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61070b7-91d6-4122-8ace-1fd7ae633154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8a9819-683a-42b2-a26c-9db8ee305994', 'volume_name': 'volume-9d8a9819-683a-42b2-a26c-9db8ee305994', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe1e262-4b37-4e76-b552-fbd36f54284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe1e262-4b37-4e76-b552-fbd36f54284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b43361-3913-4e41-adac-b8bfb63f1f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:46 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Volume 9d8a9819-683a-42b2-a26c-9db8ee305994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8a9819-683a-42b2-a26c-9db8ee305994', 'volume_size': 1} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1408710262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8a9819-683a-42b2-a26c-9db8ee305994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49deea3bec54cdbb4c1e56ff64069ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:47Z,use_quota=True,user_id='3999c158dfd54e7c93ac1f513bde4cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61485327-0be5-4ac9-a9e3-404010c7e4e8),volume_type_id=61485327-0be5-4ac9-a9e3-404010c7e4e8)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Creating volume 9d8a9819-683a-42b2-a26c-9db8ee305994 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:46 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:46 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 1073741824 Sep 09 03:47:46 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Flow 'volume_create_manager' (d8c7ffe9-b933-4264-9ee9-07cf2346f726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84ecc7d-35df-4cf2-9681-1e74f9a78f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84ecc7d-35df-4cf2-9681-1e74f9a78f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-241258849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42b4612-dabb-42bd-8af2-9cc9b1e79dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49deea3bec54cdbb4c1e56ff64069ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:47Z,use_quota=True,user_id='3999c158dfd54e7c93ac1f513bde4cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b26fb03c-64c7-498f-b5e9-f180ddfe2818),volume_type_id=b26fb03c-64c7-498f-b5e9-f180ddfe2818)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b03064-e6e4-4c74-be30-a0beb577ae59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b03064-e6e4-4c74-be30-a0beb577ae59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93005917-2e03-400b-8ccc-dc953a53cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93005917-2e03-400b-8ccc-dc953a53cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42b4612-dabb-42bd-8af2-9cc9b1e79dc1', 'volume_name': 'volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b653b4d5-5519-4da7-8eb5-4473382cf3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b653b4d5-5519-4da7-8eb5-4473382cf3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee941e5a-1995-45ab-b235-795a31093774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Volume c42b4612-dabb-42bd-8af2-9cc9b1e79dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1', 'volume_size': 1} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:47 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 1073741824" returned: 0 in 0.704s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:47 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 Sep 09 03:47:47 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:47 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994" returned: 0 in 0.322s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-241258849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42b4612-dabb-42bd-8af2-9cc9b1e79dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49deea3bec54cdbb4c1e56ff64069ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:47Z,use_quota=True,user_id='3999c158dfd54e7c93ac1f513bde4cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b26fb03c-64c7-498f-b5e9-f180ddfe2818),volume_type_id=b26fb03c-64c7-498f-b5e9-f180ddfe2818)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Creating volume c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:47 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b43361-3913-4e41-adac-b8bfb63f1f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8a9819-683a-42b2-a26c-9db8ee305994', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:47 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 1073741824 Sep 09 03:47:47 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68306872-805f-4b67-a29f-dcc7df60904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Volume volume-9d8a9819-683a-42b2-a26c-9db8ee305994 (9d8a9819-683a-42b2-a26c-9db8ee305994): created successfully Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68306872-805f-4b67-a29f-dcc7df60904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Flow 'volume_create_manager' (2c15ad5c-bcef-462e-b9fb-97320b1c5666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:47 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4c203d85-80b0-42f5-8b6a-a4c44fa5419c tempest-TestInstancesWithCinderVolumes-464600528 None] Created volume successfully. Sep 09 03:47:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3f048db2-698c-4201-ac4b-a21b53db0b63 tempest-GroupsV314Test-2133473711 None] Group tempest-GroupsV314Test-Group-1263293461: creating Sep 09 03:47:48 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 1073741824" returned: 0 in 0.591s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3f048db2-698c-4201-ac4b-a21b53db0b63 tempest-GroupsV314Test-2133473711 None] Group tempest-GroupsV314Test-Group-1263293461: created successfully Sep 09 03:47:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3f048db2-698c-4201-ac4b-a21b53db0b63 tempest-GroupsV314Test-2133473711 None] Create group completed successfully. Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:48 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 Sep 09 03:47:48 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Flow 'volume_create_manager' (f4988cc4-cf73-4e44-91c7-d938aa32d9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01326528-edd2-4f95-a9da-b50e9138fe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01326528-edd2-4f95-a9da-b50e9138fe29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-563656705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e3288f-7c56-485f-a9b1-2796bb4ee217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49deea3bec54cdbb4c1e56ff64069ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:49Z,use_quota=True,user_id='3999c158dfd54e7c93ac1f513bde4cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa5eb4ee-4abe-4a73-ac1a-10e6cc4acba0),volume_type_id=aa5eb4ee-4abe-4a73-ac1a-10e6cc4acba0)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd982a2-5d85-4303-b866-5054395c7a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd982a2-5d85-4303-b866-5054395c7a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6059a9b3-f18d-47bc-9545-daf30df2ae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:47:48 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1" returned: 0 in 0.257s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee941e5a-1995-45ab-b235-795a31093774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26110845-417b-45d4-9885-9624712636f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:48 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Volume volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 (c42b4612-dabb-42bd-8af2-9cc9b1e79dc1): created successfully Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26110845-417b-45d4-9885-9624712636f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Flow 'volume_create_manager' (d8c7ffe9-b933-4264-9ee9-07cf2346f726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-db7dbf6a-7486-42e8-9cf9-25c9987b351e tempest-TestInstancesWithCinderVolumes-464600528 None] Created volume successfully. Sep 09 03:47:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6059a9b3-f18d-47bc-9545-daf30df2ae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3e3288f-7c56-485f-a9b1-2796bb4ee217', 'volume_name': 'volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217', 'volume_size': 1, 'image_id': 'dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1208613408', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b49deea3bec54cdbb4c1e56ff64069ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'created_at': datetime.datetime(2026, 9, 9, 1, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 47, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80/file', 'properties': {}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d514bfd3-2ecd-458c-b670-222f2e0e7138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d514bfd3-2ecd-458c-b670-222f2e0e7138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6902b200-bbfa-49f2-b1dd-c1686a154a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:49 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Volume e3e3288f-7c56-485f-a9b1-2796bb4ee217: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217', 'volume_size': 1, 'image_id': 'dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1208613408', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b49deea3bec54cdbb4c1e56ff64069ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'created_at': datetime.datetime(2026, 9, 9, 1, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 47, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80/file', 'properties': {}}, 'image_service': } Sep 09 03:47:49 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Trying to clone e3e3288f-7c56-485f-a9b1-2796bb4ee217 from image dcf270ea-55e5-43bd-a9cd-c07a37c24c80 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Flow 'volume_create_manager' (ff12a632-77e1-4550-80c1-7f222503ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8baa77b7-ddb0-483f-8b96-51c1e941fe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8baa77b7-ddb0-483f-8b96-51c1e941fe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-704021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9eb65a4-44b8-426d-9dd7-b2bfe7fec99c,host='devstack@QuobyteHD#QuobyteHD',id=d019148d-ad19-4f18-b96a-9c44d786064f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3352f7b3e2e24022af6d76cad004ec8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:50Z,use_quota=True,user_id='285fc611288a43fd91c94ca308a0ab50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7837e935-9f0f-4107-8406-6d26ac4cc83e),volume_type_id=7837e935-9f0f-4107-8406-6d26ac4cc83e)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fca851c-c556-4ae0-b58d-9a0d710bdfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fca851c-c556-4ae0-b58d-9a0d710bdfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55a733e-29f0-4b3c-b646-b6cc643c8de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55a733e-29f0-4b3c-b646-b6cc643c8de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd019148d-ad19-4f18-b96a-9c44d786064f', 'volume_name': 'volume-d019148d-ad19-4f18-b96a-9c44d786064f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d463c9b2-8a61-4fd2-beb7-8ccc3d8be1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d463c9b2-8a61-4fd2-beb7-8ccc3d8be1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf740c56-7ff8-4b2b-a20c-d52f02360750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:50 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Volume d019148d-ad19-4f18-b96a-9c44d786064f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d019148d-ad19-4f18-b96a-9c44d786064f', 'volume_size': 1} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9eb65a4-44b8-426d-9dd7-b2bfe7fec99c,created_at=2026-09-09T01:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-704021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9eb65a4-44b8-426d-9dd7-b2bfe7fec99c,host='devstack@QuobyteHD#QuobyteHD',id=d019148d-ad19-4f18-b96a-9c44d786064f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3352f7b3e2e24022af6d76cad004ec8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:50Z,use_quota=True,user_id='285fc611288a43fd91c94ca308a0ab50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7837e935-9f0f-4107-8406-6d26ac4cc83e),volume_type_id=7837e935-9f0f-4107-8406-6d26ac4cc83e)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Creating volume d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:47:50 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:50 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f 1073741824 Sep 09 03:47:50 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:50 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f 1073741824" returned: 0 in 0.547s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:51 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f Sep 09 03:47:51 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:51 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f" returned: 0 in 0.373s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:47:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf740c56-7ff8-4b2b-a20c-d52f02360750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d019148d-ad19-4f18-b96a-9c44d786064f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e6bdc4-520a-4508-a5a2-59a1ce7c85d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:51 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Volume volume-d019148d-ad19-4f18-b96a-9c44d786064f (d019148d-ad19-4f18-b96a-9c44d786064f): created successfully Sep 09 03:47:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e6bdc4-520a-4508-a5a2-59a1ce7c85d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Flow 'volume_create_manager' (ff12a632-77e1-4550-80c1-7f222503ce30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fdc10a23-d8f3-42e9-ad0a-d6ea801366f4 tempest-GroupsV314Test-2133473711 None] Created volume successfully. Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:53 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Cloning volume d019148d-ad19-4f18-b96a-9c44d786064f to volume fef36edc-8be8-4c01-ac63-c3af93f6983b Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Creating offline snapshot d9a11280-ce8f-41d8-b893-e8684b83782c of volume d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0cd1f6-b8d6-4b3a-ae0a-1d00306ad779]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Flow 'volume_create_manager' (8e9630db-7665-4679-97ae-413fd470f9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6f5252-d351-423f-9794-f4771afbb04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6f5252-d351-423f-9794-f4771afbb04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1474858502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2bf47f-f8e1-4271-9997-bf827c1dcd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd257a4f41c473094504db7036bf285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:54Z,use_quota=True,user_id='010081cfedab47728810422a33130f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251179ff-3ee9-4779-8fe4-d51e88cb15a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251179ff-3ee9-4779-8fe4-d51e88cb15a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:53 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f Sep 09 03:47:53 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b173c7d-ae88-4d21-b749-ca5edc43e9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:53 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD, size 20.69 MB, duration 4.68 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:47:54 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Image download 20.69 MB at 4.42 MB/s Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb547a6-9034-4b1b-a23d-69d4cf516258]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:54 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f" returned: 0 in 0.538s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:54 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c 1G Sep 09 03:47:54 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:54 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD Sep 09 03:47:54 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b173c7d-ae88-4d21-b749-ca5edc43e9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb2bf47f-f8e1-4271-9997-bf827c1dcd88', 'volume_name': 'volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da3d2bd-f857-4ad7-b4a0-56dc573bdfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da3d2bd-f857-4ad7-b4a0-56dc573bdfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159842fd-7f93-437f-84ae-d561d1764d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:47:54 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Volume fb2bf47f-f8e1-4271-9997-bf827c1dcd88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Trying to clone fb2bf47f-f8e1-4271-9997-bf827c1dcd88 from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f at location (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:47:54 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Temporary image dcf270ea-55e5-43bd-a9cd-c07a37c24c80 is fetched for user 3999c158dfd54e7c93ac1f513bde4cd6. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4be0edd-8a84-4dce-9cba-b5127c154cad]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:54 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c 1G" returned: 0 in 0.516s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d019148d-ad19-4f18-b96a-9c44d786064f -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:54 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d019148d-ad19-4f18-b96a-9c44d786064f -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c Sep 09 03:47:54 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:47:54 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Image download 20.69 MB at 20.69 MB/s Sep 09 03:47:54 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD Sep 09 03:47:54 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0610520-f267-4c49-bb57-ff22cfc8bba3]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:55 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD Sep 09 03:47:55 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:55 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d019148d-ad19-4f18-b96a-9c44d786064f -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c" returned: 0 in 0.426s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:55 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:55 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:55 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c Sep 09 03:47:55 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:55 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f is fetched for user 010081cfedab47728810422a33130f02. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68147c-97c8-4bcc-ac1e-72e92d3ba334]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:55 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c" returned: 0 in 0.291s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:55 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD Sep 09 03:47:55 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.info Sep 09 03:47:55 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:55 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:55 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.info" returned: 0 in 0.271s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:55 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:55 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:55 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.info Sep 09 03:47:55 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:56 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.info" returned: 0 in 0.268s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Acquiring lock "cinder-quobyte-fef36edc-8be8-4c01-ac63-c3af93f6983b" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Lock "cinder-quobyte-fef36edc-8be8-4c01-ac63-c3af93f6983b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] snapshot: d9a11280-ce8f-41d8-b893-e8684b83782c, volume: fef36edc-8be8-4c01-ac63-c3af93f6983b, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95f203-1408-4242-a5cd-e0943822a2d1]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:56 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c Sep 09 03:47:56 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:56 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c" returned: 0 in 0.385s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d019148d-ad19-4f18-b96a-9c44d786064f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa60623-3fcc-48bf-bad1-ce3947323947]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:56 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f Sep 09 03:47:56 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:47:56 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f" returned: 0 in 0.381s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:47:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:47:57 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b Sep 09 03:47:57 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:02 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b" returned: 0 in 5.094s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:48:02 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Converted 1024.00 MB image at 200.97 MB/s Sep 09 03:48:02 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b is being set with open permissions: ugo+rw: NotImplementedError Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:02 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b Sep 09 03:48:02 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:02 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b" returned: 0 in 0.260s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Lock "cinder-quobyte-fef36edc-8be8-4c01-ac63-c3af93f6983b" released by "_copy_volume_from_snapshot" :: held 6.195s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Acquiring lock "cinder-quobyte-d9a11280-ce8f-41d8-b893-e8684b83782c" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Lock "cinder-quobyte-d9a11280-ce8f-41d8-b893-e8684b83782c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Deleting offline snapshot d9a11280-ce8f-41d8-b893-e8684b83782c of volume d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] snapshot_file for this snap is: volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b90d836-acbb-48d9-886a-62fb6fd3ccbd]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:02 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c Sep 09 03:48:02 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:02 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c" returned: 0 in 0.358s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d019148d-ad19-4f18-b96a-9c44d786064f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ffca0-3148-4366-a812-f0b8cf993996]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:02 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f Sep 09 03:48:02 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:03 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f" returned: 0 in 0.532s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:03 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c Sep 09 03:48:03 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:03 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c" returned: 0 in 0.357s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:03 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c Sep 09 03:48:03 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:03 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f.d9a11280-ce8f-41d8-b893-e8684b83782c" returned: 0 in 0.250s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Lock "cinder-quobyte-d9a11280-ce8f-41d8-b893-e8684b83782c" released by "_delete_snapshot" :: held 1.599s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.330s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.716s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-563656705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e3288f-7c56-485f-a9b1-2796bb4ee217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49deea3bec54cdbb4c1e56ff64069ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:49Z,use_quota=True,user_id='3999c158dfd54e7c93ac1f513bde4cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa5eb4ee-4abe-4a73-ac1a-10e6cc4acba0),volume_type_id=aa5eb4ee-4abe-4a73-ac1a-10e6cc4acba0)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Creating volume e3e3288f-7c56-485f-a9b1-2796bb4ee217 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:04 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:04 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 1073741824 Sep 09 03:48:04 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-dc8d5a9e-e690-46f9-8c1a-3fd6adf5205a tempest-GroupsV314Test-2133473711 None] Create group from source-group-f9eb65a4-44b8-426d-9dd7-b2bfe7fec99c completed successfully. Sep 09 03:48:04 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 1073741824" returned: 0 in 0.509s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:04 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 Sep 09 03:48:04 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Acquiring lock "cinder-quobyte-fef36edc-8be8-4c01-ac63-c3af93f6983b" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Lock "cinder-quobyte-fef36edc-8be8-4c01-ac63-c3af93f6983b" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1897395c-526f-4f3a-a208-64b9798a7b8d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:04 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217" returned: 0 in 0.314s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.030s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1474858502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2bf47f-f8e1-4271-9997-bf827c1dcd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd257a4f41c473094504db7036bf285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:47:54Z,use_quota=True,user_id='010081cfedab47728810422a33130f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Creating volume fb2bf47f-f8e1-4271-9997-bf827c1dcd88 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:04 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:04 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b Sep 09 03:48:04 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:04 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 1073741824 Sep 09 03:48:04 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:04 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Attempting download of dcf270ea-55e5-43bd-a9cd-c07a37c24c80 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'metadata': {}}])) to volume e3e3288f-7c56-485f-a9b1-2796bb4ee217. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e274ed-d9a6-4c74-b91f-1f269ad07ad5]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_hgvpnvw1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:05 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_hgvpnvw1 Sep 09 03:48:05 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:05 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b" returned: 0 in 0.457s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:05 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b Sep 09 03:48:05 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:05 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 1073741824" returned: 0 in 0.478s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:05 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_hgvpnvw1" returned: 0 in 0.379s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_hgvpnvw1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:05 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 Sep 09 03:48:05 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:05 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fef36edc-8be8-4c01-ac63-c3af93f6983b" returned: 0 in 0.314s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Lock "cinder-quobyte-fef36edc-8be8-4c01-ac63-c3af93f6983b" released by "delete_volume" :: held 0.822s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:05 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_hgvpnvw1 Sep 09 03:48:05 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Created reservations ['8371d49c-4d93-4aba-9a5d-b6c548b277cd'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:05 devstack cinder-volume[87597]: WARNING cinder.quota [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-637802694 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-637802694, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:48:05 devstack cinder-volume[87597]: WARNING cinder.quota [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-637802694 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-637802694, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Created reservations ['318e8c40-e81b-471a-911d-aaf87e011ab3', '852861a7-b716-473f-8ada-a0e052852cf3', '37305f54-cc8e-466d-b7f2-0c39fa7d895a', '7f2cb692-74a7-4c61-95e5-0fbd40010958'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:05 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88" returned: 0 in 0.318s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Attempting download of 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume fb2bf47f-f8e1-4271-9997-bf827c1dcd88. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[872e1812-b843-44ef-89d3-95b4679a4603]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_ka7p0rj6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:05 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_hgvpnvw1" returned: 1 in 0.503s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_hgvpnvw1' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a650920-2a14-4d2b-9ef6-9445dab5b7dd]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:05 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:05 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:05 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Flow 'volume_create_manager' (77e82309-57aa-4141-9d0c-a040a5551d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf1298b-3e50-42e6-8cd1-373ff1140797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf1298b-3e50-42e6-8cd1-373ff1140797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-938115233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61ee12f01a4433894364e933903697d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:06Z,use_quota=True,user_id='19d718a1b9cd4d7184bb155148276116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc27a68f-599d-41bc-ab22-0f4d8efbd964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc27a68f-599d-41bc-ab22-0f4d8efbd964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f12d7d5-8599-4cd4-b476-3ee990043e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f12d7d5-8599-4cd4-b476-3ee990043e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8', 'volume_name': 'volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d3e16a-6bbe-4273-bda7-070a8ca9cd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d3e16a-6bbe-4273-bda7-070a8ca9cd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e0503d-c343-40c7-89ec-b03d79c20b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:06 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Volume 93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8', 'volume_size': 1} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-938115233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61ee12f01a4433894364e933903697d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:06Z,use_quota=True,user_id='19d718a1b9cd4d7184bb155148276116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Creating volume 93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:06 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_ka7p0rj6 Sep 09 03:48:06 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:06 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 1073741824 Sep 09 03:48:06 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD Sep 09 03:48:06 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.365s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:06 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-242d56b1-d436-4a42-9ec1-fddd12f8b885 tempest-GroupsV314Test-2133473711 None] Delete group completed successfully. Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Acquiring lock "cinder-quobyte-d019148d-ad19-4f18-b96a-9c44d786064f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Lock "cinder-quobyte-d019148d-ad19-4f18-b96a-9c44d786064f" acquired by "delete_volume" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:06 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_ka7p0rj6" returned: 0 in 0.531s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_ka7p0rj6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d7eb7a-7ad9-49a9-b6ad-e9197c57f4f5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:06 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] dcf270ea-55e5-43bd-a9cd-c07a37c24c80 was qcow2, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:06 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 Sep 09 03:48:06 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f Sep 09 03:48:06 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_ka7p0rj6 Sep 09 03:48:06 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 1073741824" returned: 0 in 0.555s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:06 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 Sep 09 03:48:06 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_ka7p0rj6" returned: 1 in 0.398s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_ka7p0rj6' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[807b57e7-23b5-4b3e-9173-b5d64633a98b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:06 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f" returned: 0 in 0.473s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:06 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f Sep 09 03:48:06 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD Sep 09 03:48:06 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:06 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8" returned: 0 in 0.274s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e0503d-c343-40c7-89ec-b03d79c20b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e6e078-ee6a-4b0d-a844-b701fd9db032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:07 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Volume volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 (93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8): created successfully Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e6e078-ee6a-4b0d-a844-b701fd9db032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Flow 'volume_create_manager' (77e82309-57aa-4141-9d0c-a040a5551d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-260163e1-e914-40bb-89a3-89663df38c7b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Created volume successfully. Sep 09 03:48:07 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d019148d-ad19-4f18-b96a-9c44d786064f" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Lock "cinder-quobyte-d019148d-ad19-4f18-b96a-9c44d786064f" released by "delete_volume" :: held 0.875s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:07 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f was qcow2, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:07 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 Sep 09 03:48:07 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Created reservations ['278c5a7a-e5d0-46ef-b329-67030e397ebe'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Created reservations ['3cadacdc-e8d4-49c6-a5e4-4f5ef9af4518', '59e6c2cc-f87b-4206-9eaa-122018f141b8', '2128499f-4545-44d2-8a7b-ede194471bac', '705915ad-597c-4f40-8c38-5143feb6d42a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:07 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:07 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:07 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.309s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:07 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9e36a9d3-ccd7-47ef-9e37-b14b7fb443a0 tempest-GroupsV314Test-2133473711 None] Delete group completed successfully. Sep 09 03:48:08 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217" returned: 0 in 2.130s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:08 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcf270ea-55e5-43bd-a9cd-c07a37c24c80_r34x6lnddevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:48:08 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Converted 112.00 MB image at 52.54 MB/s Sep 09 03:48:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:08 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 1G Sep 09 03:48:08 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:09 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 1G" returned: 0 in 0.383s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Downloaded image dcf270ea-55e5-43bd-a9cd-c07a37c24c80 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'metadata': {}}])) to volume e3e3288f-7c56-485f-a9b1-2796bb4ee217 successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Temporary image dcf270ea-55e5-43bd-a9cd-c07a37c24c80 for user 3999c158dfd54e7c93ac1f513bde4cd6 is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Marking volume e3e3288f-7c56-485f-a9b1-2796bb4ee217 as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Copying metadata from image dcf270ea-55e5-43bd-a9cd-c07a37c24c80 to e3e3288f-7c56-485f-a9b1-2796bb4ee217. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Creating volume glance metadata for volume e3e3288f-7c56-485f-a9b1-2796bb4ee217 backed by image dcf270ea-55e5-43bd-a9cd-c07a37c24c80 with: {'image_id': 'dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'image_name': 'tempest-scenario-img--1208613408', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6902b200-bbfa-49f2-b1dd-c1686a154a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217', 'volume_size': 1, 'image_id': 'dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1208613408', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b49deea3bec54cdbb4c1e56ff64069ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dcf270ea-55e5-43bd-a9cd-c07a37c24c80', 'created_at': datetime.datetime(2026, 9, 9, 1, 47, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 47, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcf270ea-55e5-43bd-a9cd-c07a37c24c80/file', 'properties': {}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b0eeaf-bb54-4f08-a9f0-b5217cef0743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:09 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Volume volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 (e3e3288f-7c56-485f-a9b1-2796bb4ee217): created successfully Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b0eeaf-bb54-4f08-a9f0-b5217cef0743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Flow 'volume_create_manager' (f4988cc4-cf73-4e44-91c7-d938aa32d9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9be2ab3e-e3e8-4f67-872b-cfecca3975b3 tempest-TestInstancesWithCinderVolumes-464600528 None] Created volume successfully. Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Acquiring lock "cinder-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:09 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88" returned: 0 in 2.224s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_c8b0ly33devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:48:09 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Converted 112.00 MB image at 50.30 MB/s Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "cinder-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:09 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 1G Sep 09 03:48:09 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Acquiring lock "cinder-quobyte-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "cinder-quobyte-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eaeb4f-5b28-46d3-8855-0fe1f8f95410]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:09 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 Sep 09 03:48:09 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:09 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 1G" returned: 0 in 0.415s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Downloaded image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume fb2bf47f-f8e1-4271-9997-bf827c1dcd88 successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f for user 010081cfedab47728810422a33130f02 is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Marking volume fb2bf47f-f8e1-4271-9997-bf827c1dcd88 as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Copying metadata from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f to fb2bf47f-f8e1-4271-9997-bf827c1dcd88. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:48:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Creating volume glance metadata for volume fb2bf47f-f8e1-4271-9997-bf827c1dcd88 backed by image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159842fd-7f93-437f-84ae-d561d1764d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b406f6d-4867-4e80-becb-8ed501c5e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Volume volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 (fb2bf47f-f8e1-4271-9997-bf827c1dcd88): created successfully Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b406f6d-4867-4e80-becb-8ed501c5e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Flow 'volume_create_manager' (8e9630db-7665-4679-97ae-413fd470f9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5b62beb1-80d2-49bc-8211-86c47b9178f9 tempest-VolumesImageMetadata-427489050 None] Created volume successfully. Sep 09 03:48:10 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8" returned: 0 in 0.494s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:10 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8 Sep 09 03:48:10 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:10 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8" returned: 0 in 0.347s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "cinder-quobyte-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8" released by "delete_volume" :: held 0.904s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Created reservations ['25e95beb-47e0-4aa0-8193-a64989a0719f', 'ad33609b-bfc3-4275-8589-ac619c069b92', '33d7a558-18bc-413e-9c65-5dfbe7a7bd21', '48dba5dd-c272-4fa9-b461-765eb2966468'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:10 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:10 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:11 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.341s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:11 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Deleted volume successfully. Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e3803eff-8e5a-490d-9b33-46c23b96244b tempest-VolumeQuotasNegativeTestJSON-1483858769 None] Lock "cinder-93a2b10a-b97b-4c71-ac62-bdf7ae68f2f8-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Acquiring lock "cinder-fb2bf47f-f8e1-4271-9997-bf827c1dcd88-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Lock "cinder-fb2bf47f-f8e1-4271-9997-bf827c1dcd88-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Acquiring lock "cinder-quobyte-fb2bf47f-f8e1-4271-9997-bf827c1dcd88" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Lock "cinder-quobyte-fb2bf47f-f8e1-4271-9997-bf827c1dcd88" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdbcb69-7c45-4765-85c7-38c4275ba712]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:11 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 Sep 09 03:48:11 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:11 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88" returned: 0 in 0.484s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:12 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88 Sep 09 03:48:12 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:12 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb2bf47f-f8e1-4271-9997-bf827c1dcd88" returned: 0 in 0.362s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Lock "cinder-quobyte-fb2bf47f-f8e1-4271-9997-bf827c1dcd88" released by "delete_volume" :: held 0.905s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Created reservations ['6d8b7c55-2985-47b6-b483-1e01b9ccb75a', 'fedba70c-7f17-4305-9a5c-6fff41029b7a', 'c51a0f40-23a8-446d-a40b-3994c8fe6f0b', 'd567937e-ab40-4d38-bbda-5bbea3a295f3'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:12 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:12 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:12 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.330s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:12 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Deleted volume successfully. Sep 09 03:48:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3dfd37f7-cb37-40cb-bf57-9afdad61d978 tempest-VolumesImageMetadata-427489050 None] Lock "cinder-fb2bf47f-f8e1-4271-9997-bf827c1dcd88-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-6f83af9a-4b2a-472c-9453-3949f00f1d38 req-db4f8b3f-5003-4ceb-97df-5291aa2655a7 tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-6f83af9a-4b2a-472c-9453-3949f00f1d38 req-db4f8b3f-5003-4ceb-97df-5291aa2655a7 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-6f83af9a-4b2a-472c-9453-3949f00f1d38 req-db4f8b3f-5003-4ceb-97df-5291aa2655a7 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-6f83af9a-4b2a-472c-9453-3949f00f1d38 req-db4f8b3f-5003-4ceb-97df-5291aa2655a7 tempest-TestInstancesWithCinderVolumes-464600528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '571fff20-2ea1-46a6-9531-54f96f879281', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:48:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-6f83af9a-4b2a-472c-9453-3949f00f1d38 req-db4f8b3f-5003-4ceb-97df-5291aa2655a7 tempest-TestInstancesWithCinderVolumes-464600528 None] attachment_update completed successfully. Sep 09 03:48:20 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:48:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Flow 'volume_create_manager' (2138cedb-c230-446f-8524-006868145320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc97e15-1dc7-418e-9750-594993f0713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc97e15-1dc7-418e-9750-594993f0713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2125549366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d860212-e92b-4ced-ab60-f94c82c01896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea5d8560816428381b57e025b4a8325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:21Z,use_quota=True,user_id='be0c84aa9f68493ca206be78e5132caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58e6b51-1be9-4708-ad08-e161e4694298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58e6b51-1be9-4708-ad08-e161e4694298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77321fec-9ae3-45ea-9660-223ad4345a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77321fec-9ae3-45ea-9660-223ad4345a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d860212-e92b-4ced-ab60-f94c82c01896', 'volume_name': 'volume-1d860212-e92b-4ced-ab60-f94c82c01896', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea6ae43-5362-4bac-aa99-7c2e050d3776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea6ae43-5362-4bac-aa99-7c2e050d3776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52480f9f-8c72-48d3-90e6-6b440264340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:21 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Volume 1d860212-e92b-4ced-ab60-f94c82c01896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d860212-e92b-4ced-ab60-f94c82c01896', 'volume_size': 1} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2125549366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d860212-e92b-4ced-ab60-f94c82c01896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea5d8560816428381b57e025b4a8325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:21Z,use_quota=True,user_id='be0c84aa9f68493ca206be78e5132caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Creating volume 1d860212-e92b-4ced-ab60-f94c82c01896 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:21 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:21 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 1073741824 Sep 09 03:48:21 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:21 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 1073741824" returned: 0 in 0.747s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:21 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 Sep 09 03:48:21 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:22 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896" returned: 0 in 0.576s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52480f9f-8c72-48d3-90e6-6b440264340f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d860212-e92b-4ced-ab60-f94c82c01896', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f62fbd5-615a-41e6-8438-2968b17e2f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:22 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Volume volume-1d860212-e92b-4ced-ab60-f94c82c01896 (1d860212-e92b-4ced-ab60-f94c82c01896): created successfully Sep 09 03:48:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f62fbd5-615a-41e6-8438-2968b17e2f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Flow 'volume_create_manager' (2138cedb-c230-446f-8524-006868145320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:22 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8d3edd6b-e89c-4073-a6eb-1a1943293d81 tempest-SnapshotMetadataTestJSON-1615842366 None] Created volume successfully. Sep 09 03:48:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Creating offline snapshot 09804020-fb4a-471a-b6ce-e93e03fb75c6 of volume 1d860212-e92b-4ced-ab60-f94c82c01896 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:48:23 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0a5a15-99ca-4ff6-bfa2-12395cc72f51]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:23 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 Sep 09 03:48:23 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:24 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896" returned: 0 in 0.840s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:24 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 1G Sep 09 03:48:24 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:25 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 1G" returned: 0 in 0.779s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d860212-e92b-4ced-ab60-f94c82c01896 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:25 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d860212-e92b-4ced-ab60-f94c82c01896 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 Sep 09 03:48:25 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:25 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d860212-e92b-4ced-ab60-f94c82c01896 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6" returned: 0 in 0.686s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:25 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 is being set with open permissions: ugo+rw Sep 09 03:48:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:25 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 Sep 09 03:48:25 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:26 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6" returned: 0 in 0.443s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:26 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.info Sep 09 03:48:26 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:26 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.info" returned: 0 in 0.606s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:26 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.info is being set with open permissions: ugo+rw Sep 09 03:48:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:26 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.info Sep 09 03:48:26 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:27 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.info" returned: 0 in 0.592s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.144s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:27 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b5651923-71f6-4ad8-abae-4db6a8f2428f tempest-SnapshotMetadataTestJSON-1615842366 None] Create snapshot completed successfully Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "cinder-09804020-fb4a-471a-b6ce-e93e03fb75c6-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-09804020-fb4a-471a-b6ce-e93e03fb75c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "cinder-quobyte-1d860212-e92b-4ced-ab60-f94c82c01896" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-quobyte-1d860212-e92b-4ced-ab60-f94c82c01896" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "cinder-quobyte-09804020-fb4a-471a-b6ce-e93e03fb75c6" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-quobyte-09804020-fb4a-471a-b6ce-e93e03fb75c6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Deleting offline snapshot 09804020-fb4a-471a-b6ce-e93e03fb75c6 of volume 1d860212-e92b-4ced-ab60-f94c82c01896 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] snapshot_file for this snap is: volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb605530-f68f-4ae1-b712-d8733a858215]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:30 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 Sep 09 03:48:30 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:31 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6" returned: 0 in 0.625s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d860212-e92b-4ced-ab60-f94c82c01896(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:48:31 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[570e6ec4-8726-44e0-90c4-2dd59c3152ed]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:31 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 Sep 09 03:48:31 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=127,cinder:UPDATE=130,cinder:INSERT=39,cinder:DELETE=8 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:48:32 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896" returned: 0 in 0.873s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:48:32 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 Sep 09 03:48:32 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Flow 'volume_create_manager' (e74a4d6c-bedc-4c7b-a320-9ed406441fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a520305-5c46-42c2-b0fc-b16963268776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a520305-5c46-42c2-b0fc-b16963268776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-959438526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e06a9c-f59a-48af-8f64-6e87d2f1c07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0d11a939b84c64bd09664801262eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:32Z,use_quota=True,user_id='f1eb9c3c95714d5bb6f95989d67a04e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8544e51-3f55-4502-88df-525c9b34f92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8544e51-3f55-4502-88df-525c9b34f92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab855bf7-2e1c-4061-ab22-ff84302da1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab855bf7-2e1c-4061-ab22-ff84302da1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e06a9c-f59a-48af-8f64-6e87d2f1c07e', 'volume_name': 'volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9206b152-984a-4c78-b618-60da3103591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9206b152-984a-4c78-b618-60da3103591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678137cb-cc8a-4553-af9e-209b239cf160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Volume b2e06a9c-f59a-48af-8f64-6e87d2f1c07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e', 'volume_size': 1} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-959438526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e06a9c-f59a-48af-8f64-6e87d2f1c07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0d11a939b84c64bd09664801262eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:32Z,use_quota=True,user_id='f1eb9c3c95714d5bb6f95989d67a04e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Creating volume b2e06a9c-f59a-48af-8f64-6e87d2f1c07e {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:32 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:32 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e 1073741824 Sep 09 03:48:32 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:32 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6" returned: 0 in 0.569s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:32 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6 Sep 09 03:48:32 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:33 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e 1073741824" returned: 0 in 0.599s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:33 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e Sep 09 03:48:33 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:33 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896.09804020-fb4a-471a-b6ce-e93e03fb75c6" returned: 0 in 0.331s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-quobyte-09804020-fb4a-471a-b6ce-e93e03fb75c6" released by "_delete_snapshot" :: held 2.582s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-quobyte-1d860212-e92b-4ced-ab60-f94c82c01896" released by "delete_snapshot" :: held 2.624s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Created reservations ['84b4771c-8aef-4b4c-b82c-03e9d95786fc', '5c623926-9c9e-4388-a220-18f6b3104dea', 'cf3037fe-4687-44b9-9714-f52702ccdc21', 'da6f683e-378a-4d8b-a01b-1cf269da231b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:33 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Delete snapshot completed successfully. Sep 09 03:48:33 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ebd5819a-f28b-4d2f-b5c2-6cc7c14b651f tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-09804020-fb4a-471a-b6ce-e93e03fb75c6-delete_snapshot" released by "delete_snapshot" :: held 2.848s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e" returned: 0 in 0.330s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678137cb-cc8a-4553-af9e-209b239cf160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03c8cb0-e3a7-45db-9255-44287cf8d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:33 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Volume volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e (b2e06a9c-f59a-48af-8f64-6e87d2f1c07e): created successfully Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03c8cb0-e3a7-45db-9255-44287cf8d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Flow 'volume_create_manager' (e74a4d6c-bedc-4c7b-a320-9ed406441fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:33 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-74fdb7d5-afe7-4a6f-82e6-d99731cb0b89 tempest-VolumeQuotasAdminTestJSON-724129329 None] Created volume successfully. Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "cinder-1d860212-e92b-4ced-ab60-f94c82c01896-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-1d860212-e92b-4ced-ab60-f94c82c01896-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "cinder-quobyte-1d860212-e92b-4ced-ab60-f94c82c01896" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-quobyte-1d860212-e92b-4ced-ab60-f94c82c01896" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee8a135-5a26-4ad3-a0eb-39c62b575fbc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Acquiring lock "cinder-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "cinder-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:34 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 Sep 09 03:48:34 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Acquiring lock "cinder-quobyte-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "cinder-quobyte-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e" acquired by "delete_volume" :: waited 0.048s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1aaafa-e0ef-4bfa-a310-5b113cf5bef2]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:35 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e Sep 09 03:48:35 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:35 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896" returned: 0 in 0.688s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:35 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896 Sep 09 03:48:35 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:35 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e" returned: 0 in 0.609s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:35 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e Sep 09 03:48:35 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:35 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d860212-e92b-4ced-ab60-f94c82c01896" returned: 0 in 0.350s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-quobyte-1d860212-e92b-4ced-ab60-f94c82c01896" released by "delete_volume" :: held 1.165s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Created reservations ['da621705-bd72-4db5-9027-ac7886fb04bc', 'fe5c9016-000a-40a5-8512-74d7aaa649dc', '84b605f0-44fc-4501-b940-10e6364d7551', '0153a15f-2e6f-458d-a152-fcbd3779c589'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:35 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:35 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:35 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e" returned: 0 in 0.326s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "cinder-quobyte-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e" released by "delete_volume" :: held 1.021s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:35 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Created reservations ['2a2afa0a-266d-4cf8-9eb3-ab7ca0c8ad64', 'c1f1d7ee-da10-4dd3-b8da-abe6c316085a', 'aaf32036-6702-4072-815c-021dbdb92dca', '54b12f74-d147-4f07-9e4b-bb9c9dfb6ff5'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:36 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.322s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:36 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Deleted volume successfully. Sep 09 03:48:36 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:36 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fec13a91-6569-4c16-a6d9-3b29d18d4852 tempest-SnapshotMetadataTestJSON-1615842366 None] Lock "cinder-1d860212-e92b-4ced-ab60-f94c82c01896-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:36 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:36 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Deleted volume successfully. Sep 09 03:48:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49a9c7d2-89cc-4d83-b26a-0a7a3988ab82 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "cinder-b2e06a9c-f59a-48af-8f64-6e87d2f1c07e-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:48:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:48:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Flow 'volume_create_manager' (75a11a2d-126f-403b-80c4-1ec60e694f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebdbb80-8cd5-45a5-9fb5-d530f35fd08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebdbb80-8cd5-45a5-9fb5-d530f35fd08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-148678745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02237781-4a84-42d6-bca6-d08a79da8d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0d11a939b84c64bd09664801262eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:38Z,use_quota=True,user_id='f1eb9c3c95714d5bb6f95989d67a04e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4189d49-e7be-431b-9284-fac09dc31df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4189d49-e7be-431b-9284-fac09dc31df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed98b22-f2cc-462a-a01e-d4bea55d37f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed98b22-f2cc-462a-a01e-d4bea55d37f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02237781-4a84-42d6-bca6-d08a79da8d01', 'volume_name': 'volume-02237781-4a84-42d6-bca6-d08a79da8d01', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e4c085-94f7-4125-ab33-21fedd7f199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e4c085-94f7-4125-ab33-21fedd7f199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ec501a-2c3a-4a17-972a-92a8c1276770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Volume 02237781-4a84-42d6-bca6-d08a79da8d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02237781-4a84-42d6-bca6-d08a79da8d01', 'volume_size': 1} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-148678745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02237781-4a84-42d6-bca6-d08a79da8d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0d11a939b84c64bd09664801262eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:38Z,use_quota=True,user_id='f1eb9c3c95714d5bb6f95989d67a04e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Creating volume 02237781-4a84-42d6-bca6-d08a79da8d01 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:38 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:38 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 1073741824 Sep 09 03:48:38 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:38 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 1073741824" returned: 0 in 0.529s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:38 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 Sep 09 03:48:38 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Flow 'volume_create_manager' (b31eee10-c972-4785-ab66-a4fcf62ea675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8813cd80-4c2d-4d52-9207-b3537da13365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8813cd80-4c2d-4d52-9207-b3537da13365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1644149387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1838c8ce-11bb-4c09-9824-22575a359e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746690f6ebf7437c99e539c0b529cd9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:39Z,use_quota=True,user_id='5c8dbe7649da4a4589a8ce40c6b3beab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3907d3-bb73-41d7-b07b-d15138bc4c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3907d3-bb73-41d7-b07b-d15138bc4c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b370e6ce-2638-47bd-92e2-34d5b5c4561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b370e6ce-2638-47bd-92e2-34d5b5c4561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1838c8ce-11bb-4c09-9824-22575a359e73', 'volume_name': 'volume-1838c8ce-11bb-4c09-9824-22575a359e73', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b18172-c3b5-45a4-96cc-42a5f8072ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b18172-c3b5-45a4-96cc-42a5f8072ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a1085f-0168-45a5-af96-3f3213c99867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Volume 1838c8ce-11bb-4c09-9824-22575a359e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1838c8ce-11bb-4c09-9824-22575a359e73', 'volume_size': 1} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:39 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01" returned: 0 in 0.341s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1644149387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1838c8ce-11bb-4c09-9824-22575a359e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746690f6ebf7437c99e539c0b529cd9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:39Z,use_quota=True,user_id='5c8dbe7649da4a4589a8ce40c6b3beab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Creating volume 1838c8ce-11bb-4c09-9824-22575a359e73 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:39 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ec501a-2c3a-4a17-972a-92a8c1276770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02237781-4a84-42d6-bca6-d08a79da8d01', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291b30eb-8cd1-466a-854d-6bdf7417cbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:39 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 1073741824 Sep 09 03:48:39 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Volume volume-02237781-4a84-42d6-bca6-d08a79da8d01 (02237781-4a84-42d6-bca6-d08a79da8d01): created successfully Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291b30eb-8cd1-466a-854d-6bdf7417cbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Flow 'volume_create_manager' (75a11a2d-126f-403b-80c4-1ec60e694f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8fd2d6b7-1947-40ac-8c1d-f759425bd403 tempest-VolumeQuotasAdminTestJSON-724129329 None] Created volume successfully. Sep 09 03:48:39 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 1073741824" returned: 0 in 0.472s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:INSERT=36,cinder:UPDATE=112,cinder:SELECT=88,cinder:DELETE=6 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:39 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 Sep 09 03:48:39 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:39 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73" returned: 0 in 0.267s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a1085f-0168-45a5-af96-3f3213c99867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1838c8ce-11bb-4c09-9824-22575a359e73', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11196c81-76ae-4a94-9a19-edfaf2947ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Volume volume-1838c8ce-11bb-4c09-9824-22575a359e73 (1838c8ce-11bb-4c09-9824-22575a359e73): created successfully Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11196c81-76ae-4a94-9a19-edfaf2947ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Flow 'volume_create_manager' (b31eee10-c972-4785-ab66-a4fcf62ea675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e02fcacd-a884-46da-8810-fc33cc82848c tempest-AbsoluteLimitsTests-288865095 None] Created volume successfully. Sep 09 03:48:40 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-252bbadc-7f3c-4de2-9469-905f9b4150dd tempest-VolumeQuotasAdminTestJSON-1564896190 None] Transfer volume completed successfully. Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Flow 'volume_create_manager' (3b45897d-3c6e-42b9-b35f-5d15da3184c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aef20fc-28d9-48fb-80ff-aacf1a1df2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aef20fc-28d9-48fb-80ff-aacf1a1df2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1770394846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddec1915-4158-4cdb-a551-1e92c0a31691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7012a7ed997f4837834005ee5804765b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:41Z,use_quota=True,user_id='161b8eeb8f6a4578bd08421fea6b41f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f4d406-316d-4ed6-b1e2-c8eac54a9652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f4d406-316d-4ed6-b1e2-c8eac54a9652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec85f3c6-68c5-40b1-b837-cfc2a1e6bf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec85f3c6-68c5-40b1-b837-cfc2a1e6bf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddec1915-4158-4cdb-a551-1e92c0a31691', 'volume_name': 'volume-ddec1915-4158-4cdb-a551-1e92c0a31691', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d49f0a0-1a3d-4b98-86f5-ac80bbbc0529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d49f0a0-1a3d-4b98-86f5-ac80bbbc0529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94047f9-18f8-44c4-99e3-eb3a8193447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:41 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Volume ddec1915-4158-4cdb-a551-1e92c0a31691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddec1915-4158-4cdb-a551-1e92c0a31691', 'volume_size': 1} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1770394846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddec1915-4158-4cdb-a551-1e92c0a31691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7012a7ed997f4837834005ee5804765b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:41Z,use_quota=True,user_id='161b8eeb8f6a4578bd08421fea6b41f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Creating volume ddec1915-4158-4cdb-a551-1e92c0a31691 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:41 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:41 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 1073741824 Sep 09 03:48:41 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Acquiring lock "cinder-1838c8ce-11bb-4c09-9824-22575a359e73-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Acquiring lock "cinder-02237781-4a84-42d6-bca6-d08a79da8d01-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Lock "cinder-1838c8ce-11bb-4c09-9824-22575a359e73-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Lock "cinder-02237781-4a84-42d6-bca6-d08a79da8d01-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Acquiring lock "cinder-quobyte-1838c8ce-11bb-4c09-9824-22575a359e73" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Acquiring lock "cinder-quobyte-02237781-4a84-42d6-bca6-d08a79da8d01" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Lock "cinder-quobyte-1838c8ce-11bb-4c09-9824-22575a359e73" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f760d8d8-f4d0-4894-9880-02bd2c5e72e6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Lock "cinder-quobyte-02237781-4a84-42d6-bca6-d08a79da8d01" acquired by "delete_volume" :: waited 0.049s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[da75d308-4b1c-4ed9-9e95-5f6e0f8e8fde]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:41 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 Sep 09 03:48:41 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:41 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 Sep 09 03:48:41 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:41 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 1073741824" returned: 0 in 0.521s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:41 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 Sep 09 03:48:41 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:42 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73" returned: 0 in 0.400s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:42 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73 Sep 09 03:48:42 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:42 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01" returned: 0 in 0.424s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:42 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01 Sep 09 03:48:42 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:42 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691" returned: 0 in 0.350s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94047f9-18f8-44c4-99e3-eb3a8193447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddec1915-4158-4cdb-a551-1e92c0a31691', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42acd20b-559f-4627-b6cf-293cde939d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:42 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Volume volume-ddec1915-4158-4cdb-a551-1e92c0a31691 (ddec1915-4158-4cdb-a551-1e92c0a31691): created successfully Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42acd20b-559f-4627-b6cf-293cde939d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Flow 'volume_create_manager' (3b45897d-3c6e-42b9-b35f-5d15da3184c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-445b2139-2578-43ac-a93a-6b8c82588e18 tempest-VolumesMetadataTest-1850717575 None] Created volume successfully. Sep 09 03:48:42 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1838c8ce-11bb-4c09-9824-22575a359e73" returned: 0 in 0.304s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Lock "cinder-quobyte-1838c8ce-11bb-4c09-9824-22575a359e73" released by "delete_volume" :: held 0.750s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:42 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-02237781-4a84-42d6-bca6-d08a79da8d01" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Lock "cinder-quobyte-02237781-4a84-42d6-bca6-d08a79da8d01" released by "delete_volume" :: held 0.761s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Created reservations ['b753b3ae-9459-4f0f-9b98-01af32f873f5', '5ee1ab29-43fb-491c-b467-26aef16d5067', 'fe5c3358-cf85-461b-a9a3-312cb1665c23', '946b2064-0d57-43c5-8154-69a268526bd4'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Created reservations ['2e142871-df41-443a-aa5f-379da7ef627e', '0602f4c3-a64c-4233-aae1-0c93a3666236', '3ed5b529-a591-40f7-bc8e-29029e3f85db', 'f48fd025-eef6-4ca7-9cf3-34d1b37bb0fe'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:42 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:42 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:42 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:42 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:42 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.260s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Deleted volume successfully. Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-60f0dd2b-3a01-4173-a752-3cae7c381efe tempest-AbsoluteLimitsTests-288865095 None] Lock "cinder-1838c8ce-11bb-4c09-9824-22575a359e73-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:42 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.312s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Deleted volume successfully. Sep 09 03:48:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f37670d7-d659-4ba5-b5bb-ab6dd1a5cadb tempest-VolumeQuotasAdminTestJSON-1459681679 None] Lock "cinder-02237781-4a84-42d6-bca6-d08a79da8d01-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Acquiring lock "cinder-ddec1915-4158-4cdb-a551-1e92c0a31691-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Lock "cinder-ddec1915-4158-4cdb-a551-1e92c0a31691-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Acquiring lock "cinder-quobyte-ddec1915-4158-4cdb-a551-1e92c0a31691" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Lock "cinder-quobyte-ddec1915-4158-4cdb-a551-1e92c0a31691" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:44 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d422bf43-70f7-4bae-88df-0be7984b5c59]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:44 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 Sep 09 03:48:44 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:45 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691" returned: 0 in 0.549s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:45 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691 Sep 09 03:48:45 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:45 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ddec1915-4158-4cdb-a551-1e92c0a31691" returned: 0 in 0.322s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Lock "cinder-quobyte-ddec1915-4158-4cdb-a551-1e92c0a31691" released by "delete_volume" :: held 0.945s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Created reservations ['191457be-92e4-42fb-8e11-9f1d4eb4913b', '587956a3-5875-4d40-b744-f75b3672eec7', '7b8ba3c1-149d-4a5a-a2b7-60919c80a857', 'f6f863b2-7dde-495e-a795-4a2165fc5752'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:45 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:45 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:46 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.382s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:46 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Deleted volume successfully. Sep 09 03:48:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c6e37bc7-0784-48e2-9f2d-986b23fe5424 tempest-VolumesMetadataTest-1850717575 None] Lock "cinder-ddec1915-4158-4cdb-a551-1e92c0a31691-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Flow 'volume_create_manager' (81db3c51-e24a-480a-a8c5-dc54b24f28d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55f0ed5-96be-4874-9529-f7ac7bacdc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55f0ed5-96be-4874-9529-f7ac7bacdc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-484083443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abaf63f5-8908-46d9-97f3-cca0f2f566de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33c709e257940949a0e053934664ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:53Z,use_quota=True,user_id='660f5df7c0b54c2999b717367794801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34a471a-d846-4103-a3e0-ac5131fe2729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34a471a-d846-4103-a3e0-ac5131fe2729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e619e5ac-1068-4fd5-a05e-3e9c1ba127cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e619e5ac-1068-4fd5-a05e-3e9c1ba127cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abaf63f5-8908-46d9-97f3-cca0f2f566de', 'volume_name': 'volume-abaf63f5-8908-46d9-97f3-cca0f2f566de', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae241d9-5b19-4616-a52f-db7e69a94762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae241d9-5b19-4616-a52f-db7e69a94762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558666d9-307a-4d11-a644-b56a4fb57c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:52 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Volume abaf63f5-8908-46d9-97f3-cca0f2f566de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abaf63f5-8908-46d9-97f3-cca0f2f566de', 'volume_size': 1} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-484083443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abaf63f5-8908-46d9-97f3-cca0f2f566de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33c709e257940949a0e053934664ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:53Z,use_quota=True,user_id='660f5df7c0b54c2999b717367794801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Creating volume abaf63f5-8908-46d9-97f3-cca0f2f566de {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:52 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:53 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de 1073741824 Sep 09 03:48:53 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-2a5fca30-0fb3-44a8-b437-4696a11d9ce1 req-87b3e02f-992a-4b98-bb4d-3657f97f0e00 tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:53 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de 1073741824" returned: 0 in 0.527s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Flow 'volume_create_manager' (e594e55b-ff98-413a-9773-2fff29c3a2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc74468e-c66a-4410-bbb5-bc65e8227bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc74468e-c66a-4410-bbb5-bc65e8227bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-954324997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73273c3c-31f6-4ebd-8091-ee686bf92b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55694ad601a3450daad949efbcd6bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:53Z,use_quota=True,user_id='6975a3da50ec474f84225859865a1c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e2d9017-a723-4771-bbb0-e9d30ad99df6),volume_type_id=4e2d9017-a723-4771-bbb0-e9d30ad99df6)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a690f491-2744-41f3-bd57-a1ecf078589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a690f491-2744-41f3-bd57-a1ecf078589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff046a9-0ad1-4882-8158-ba3582f1df46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff046a9-0ad1-4882-8158-ba3582f1df46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73273c3c-31f6-4ebd-8091-ee686bf92b24', 'volume_name': 'volume-73273c3c-31f6-4ebd-8091-ee686bf92b24', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24c4e4f-74fa-4318-89d2-0270684a9f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24c4e4f-74fa-4318-89d2-0270684a9f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccd9407-f110-42f2-94d2-5cbaffd5557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:53 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Volume 73273c3c-31f6-4ebd-8091-ee686bf92b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73273c3c-31f6-4ebd-8091-ee686bf92b24', 'volume_size': 1} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:53 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de Sep 09 03:48:53 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:53 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de" returned: 0 in 0.306s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-2a5fca30-0fb3-44a8-b437-4696a11d9ce1 req-87b3e02f-992a-4b98-bb4d-3657f97f0e00 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.742s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558666d9-307a-4d11-a644-b56a4fb57c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abaf63f5-8908-46d9-97f3-cca0f2f566de', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9bc115-4617-4b47-8946-6260dc0856a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-2a5fca30-0fb3-44a8-b437-4696a11d9ce1 req-87b3e02f-992a-4b98-bb4d-3657f97f0e00 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.102s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-954324997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73273c3c-31f6-4ebd-8091-ee686bf92b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55694ad601a3450daad949efbcd6bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:48:53Z,use_quota=True,user_id='6975a3da50ec474f84225859865a1c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e2d9017-a723-4771-bbb0-e9d30ad99df6),volume_type_id=4e2d9017-a723-4771-bbb0-e9d30ad99df6)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Creating volume 73273c3c-31f6-4ebd-8091-ee686bf92b24 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:48:54 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:54 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Volume volume-abaf63f5-8908-46d9-97f3-cca0f2f566de (abaf63f5-8908-46d9-97f3-cca0f2f566de): created successfully Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9bc115-4617-4b47-8946-6260dc0856a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Flow 'volume_create_manager' (81db3c51-e24a-480a-a8c5-dc54b24f28d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:54 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 1073741824 Sep 09 03:48:54 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-bf687161-748e-4e6e-9ef3-14eefdbae02d tempest-VolumesTransfersV355Test-309997817 None] Created volume successfully. Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-2a5fca30-0fb3-44a8-b437-4696a11d9ce1 req-87b3e02f-992a-4b98-bb4d-3657f97f0e00 tempest-TestInstancesWithCinderVolumes-464600528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-9d8a9819-683a-42b2-a26c-9db8ee305994', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce539b5e-dc89-4dae-acee-8aafedb0edcd', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:48:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-2a5fca30-0fb3-44a8-b437-4696a11d9ce1 req-87b3e02f-992a-4b98-bb4d-3657f97f0e00 tempest-TestInstancesWithCinderVolumes-464600528 None] attachment_update completed successfully. Sep 09 03:48:54 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 1073741824" returned: 0 in 0.676s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:54 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 Sep 09 03:48:54 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:55 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24" returned: 0 in 0.384s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:48:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccd9407-f110-42f2-94d2-5cbaffd5557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73273c3c-31f6-4ebd-8091-ee686bf92b24', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4a0d9c-dffa-423e-8d38-b900cd621aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:48:55 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Volume volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 (73273c3c-31f6-4ebd-8091-ee686bf92b24): created successfully Sep 09 03:48:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4a0d9c-dffa-423e-8d38-b900cd621aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:48:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Flow 'volume_create_manager' (e594e55b-ff98-413a-9773-2fff29c3a2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:48:55 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-63a032d1-81f8-472e-bb6b-b03701ecf25a tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Created volume successfully. Sep 09 03:48:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d07fb220-457f-41f6-bf19-3a66d3b229f0 tempest-VolumesTransfersV355Test-969800717 None] Transfer volume completed successfully. Sep 09 03:48:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:56 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:56 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:56 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.403s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:56 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4afc203c-c06e-41f6-83a7-6c257731843e tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Retype volume completed successfully. Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Acquiring lock "cinder-abaf63f5-8908-46d9-97f3-cca0f2f566de-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Lock "cinder-abaf63f5-8908-46d9-97f3-cca0f2f566de-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Acquiring lock "cinder-quobyte-abaf63f5-8908-46d9-97f3-cca0f2f566de" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Lock "cinder-quobyte-abaf63f5-8908-46d9-97f3-cca0f2f566de" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7afca92-b84a-4423-907c-d72ba084422d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:57 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de Sep 09 03:48:57 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-87482cb8-b639-48f0-9757-d2c717ebab84 req-c4d9b25c-5eab-4051-ad72-0d3822693ecf tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-87482cb8-b639-48f0-9757-d2c717ebab84 req-c4d9b25c-5eab-4051-ad72-0d3822693ecf tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-87482cb8-b639-48f0-9757-d2c717ebab84 req-c4d9b25c-5eab-4051-ad72-0d3822693ecf tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-87482cb8-b639-48f0-9757-d2c717ebab84 req-c4d9b25c-5eab-4051-ad72-0d3822693ecf tempest-TestInstancesWithCinderVolumes-464600528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ede9f08-721c-4afc-a9df-9ae3f59662c3', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Acquiring lock "cinder-73273c3c-31f6-4ebd-8091-ee686bf92b24-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-87482cb8-b639-48f0-9757-d2c717ebab84 req-c4d9b25c-5eab-4051-ad72-0d3822693ecf tempest-TestInstancesWithCinderVolumes-464600528 None] attachment_update completed successfully. Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "cinder-73273c3c-31f6-4ebd-8091-ee686bf92b24-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:57 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de" returned: 0 in 0.512s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:57 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de Sep 09 03:48:57 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Acquiring lock "cinder-quobyte-73273c3c-31f6-4ebd-8091-ee686bf92b24" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "cinder-quobyte-73273c3c-31f6-4ebd-8091-ee686bf92b24" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d60ba4-ae3b-4a6f-b9da-00d403979d4f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:48:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:58 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 Sep 09 03:48:58 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:58 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-abaf63f5-8908-46d9-97f3-cca0f2f566de" returned: 0 in 0.394s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Lock "cinder-quobyte-abaf63f5-8908-46d9-97f3-cca0f2f566de" released by "delete_volume" :: held 0.999s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Created reservations ['49a3be4d-9d7a-44f2-a82f-d867309f9644', 'dbf54e2c-42b4-4ab2-af1d-4ca6e61b2ef7', '2cea247a-bce0-40aa-a9c8-3a6ce4facb17', 'f1236974-e4a2-40b0-a9b7-e58108c6cd51'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:58 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24" returned: 0 in 0.609s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:58 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:58 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:58 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24 Sep 09 03:48:58 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:58 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-73273c3c-31f6-4ebd-8091-ee686bf92b24" returned: 0 in 0.368s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "cinder-quobyte-73273c3c-31f6-4ebd-8091-ee686bf92b24" released by "delete_volume" :: held 1.034s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:58 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.439s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:58 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Deleted volume successfully. Sep 09 03:48:58 devstack cinder-volume[87597]: WARNING cinder.quota [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:48:58 devstack cinder-volume[87597]: WARNING cinder.quota [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-811eaca3-c500-4c32-85e3-46b13a56b8b0 tempest-VolumesTransfersV355Test-763949830 None] Lock "cinder-abaf63f5-8908-46d9-97f3-cca0f2f566de-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:48:58 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Created reservations ['27d7339b-95ac-48e5-a553-6f24be1923ae', 'aaec4369-66c9-4b12-bc1c-619fb3a1c416', '12d5d604-0b87-4629-b473-3cf8b6891f68', '68c4441e-f680-4f5e-bacf-07bf3bd5c9d6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:48:59 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:48:59 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:48:59 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.297s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:48:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Deleted volume successfully. Sep 09 03:48:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4a157442-ed3d-4f8c-9e31-a4faea87d564 tempest-VolumeRetypeWithoutMigrationTest-872598357 None] Lock "cinder-73273c3c-31f6-4ebd-8091-ee686bf92b24-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Flow 'volume_create_manager' (1a30a043-67a2-4d3c-8f03-310af2bdfdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7415f78c-9dcb-4712-929d-8df819f0ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7415f78c-9dcb-4712-929d-8df819f0ad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-204535646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4002b515-bfed-479f-9cb5-5ba0e551f94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33c709e257940949a0e053934664ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:00Z,use_quota=True,user_id='660f5df7c0b54c2999b717367794801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2df1121-cae6-4244-9b24-9fcfc84f8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2df1121-cae6-4244-9b24-9fcfc84f8074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aebb6c-6a6f-4276-bdc2-f978897de120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aebb6c-6a6f-4276-bdc2-f978897de120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4002b515-bfed-479f-9cb5-5ba0e551f94a', 'volume_name': 'volume-4002b515-bfed-479f-9cb5-5ba0e551f94a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122e511d-ffea-4b77-998c-f1c370a001e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122e511d-ffea-4b77-998c-f1c370a001e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ed8858-232d-444a-99fb-0910782e9714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Volume 4002b515-bfed-479f-9cb5-5ba0e551f94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4002b515-bfed-479f-9cb5-5ba0e551f94a', 'volume_size': 1} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-204535646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4002b515-bfed-479f-9cb5-5ba0e551f94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33c709e257940949a0e053934664ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:00Z,use_quota=True,user_id='660f5df7c0b54c2999b717367794801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Creating volume 4002b515-bfed-479f-9cb5-5ba0e551f94a {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:49:00 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:00 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a 1073741824 Sep 09 03:49:00 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Flow 'volume_create_manager' (ae5a28fe-aa3e-496d-875c-b125e3ebf12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e77645-46aa-4dd2-840c-e307455ebd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e77645-46aa-4dd2-840c-e307455ebd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1664201234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32be3ad1-84c0-4971-9a77-580a5f14de18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8f29a52ec447b28f74b16e6ec8d7e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:01Z,use_quota=True,user_id='2cace6382d8149f5b651991ed44a98f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791ff5e5-e633-4162-829f-6b87a5841513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791ff5e5-e633-4162-829f-6b87a5841513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e263c49-9cff-48ac-a4ef-c5d662c2bfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e263c49-9cff-48ac-a4ef-c5d662c2bfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32be3ad1-84c0-4971-9a77-580a5f14de18', 'volume_name': 'volume-32be3ad1-84c0-4971-9a77-580a5f14de18', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8fc671-15fd-4fd5-b1b6-2adf274fdd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8fc671-15fd-4fd5-b1b6-2adf274fdd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541edfb7-6cb6-4bde-90b4-ee179ced00a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:00 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Volume 32be3ad1-84c0-4971-9a77-580a5f14de18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32be3ad1-84c0-4971-9a77-580a5f14de18', 'volume_size': 1} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:00 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a 1073741824" returned: 0 in 0.616s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:00 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a Sep 09 03:49:00 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:01 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1664201234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32be3ad1-84c0-4971-9a77-580a5f14de18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8f29a52ec447b28f74b16e6ec8d7e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:01Z,use_quota=True,user_id='2cace6382d8149f5b651991ed44a98f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Creating volume 32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:49:01 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ed8858-232d-444a-99fb-0910782e9714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4002b515-bfed-479f-9cb5-5ba0e551f94a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:01 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 1073741824 Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c603c3-3fe6-4010-b2cc-23cc7e13e064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:01 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:01 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Volume volume-4002b515-bfed-479f-9cb5-5ba0e551f94a (4002b515-bfed-479f-9cb5-5ba0e551f94a): created successfully Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c603c3-3fe6-4010-b2cc-23cc7e13e064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Flow 'volume_create_manager' (1a30a043-67a2-4d3c-8f03-310af2bdfdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:01 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-109f83a3-a945-4166-a337-2ab82b8a6aff tempest-VolumesTransfersV355Test-309997817 None] Created volume successfully. Sep 09 03:49:01 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 1073741824" returned: 0 in 0.528s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:01 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:49:01 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:01 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.279s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:49:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541edfb7-6cb6-4bde-90b4-ee179ced00a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32be3ad1-84c0-4971-9a77-580a5f14de18', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480bc780-b5e3-4d79-98e4-7ca0755c9f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:02 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Volume volume-32be3ad1-84c0-4971-9a77-580a5f14de18 (32be3ad1-84c0-4971-9a77-580a5f14de18): created successfully Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480bc780-b5e3-4d79-98e4-7ca0755c9f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Flow 'volume_create_manager' (ae5a28fe-aa3e-496d-875c-b125e3ebf12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:02 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-7405aa74-4df2-4cb5-a326-964e23a9a944 tempest-VolumesActionsTest-1114830499 None] Created volume successfully. Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Acquiring lock "cinder-4002b515-bfed-479f-9cb5-5ba0e551f94a-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Lock "cinder-4002b515-bfed-479f-9cb5-5ba0e551f94a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Acquiring lock "cinder-quobyte-4002b515-bfed-479f-9cb5-5ba0e551f94a" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Lock "cinder-quobyte-4002b515-bfed-479f-9cb5-5ba0e551f94a" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda313a6-f580-4e2d-ad4c-d79e18a6a0b4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:02 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a Sep 09 03:49:02 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:03 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a" returned: 0 in 0.464s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:03 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a Sep 09 03:49:03 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:03 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4002b515-bfed-479f-9cb5-5ba0e551f94a" returned: 0 in 0.372s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Lock "cinder-quobyte-4002b515-bfed-479f-9cb5-5ba0e551f94a" released by "delete_volume" :: held 0.916s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Created reservations ['49386081-0be3-4ffc-8404-45a2393ca9be', '08164805-e08f-4018-b259-a98545304778', 'e3c8190e-abd6-499d-947a-393aa21bf27c', '7aa88557-ad63-4982-bd47-ea831636537a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:03 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:49:03 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:03 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-d08aece5-0060-418b-8ba3-a196b87623ff req-00fc8884-82d7-4e1e-b47f-a1d912620b7a tempest-TestInstancesWithCinderVolumes-464600528 None] Terminate volume connection completed successfully. Sep 09 03:49:03 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-d08aece5-0060-418b-8ba3-a196b87623ff req-00fc8884-82d7-4e1e-b47f-a1d912620b7a tempest-TestInstancesWithCinderVolumes-464600528 None] Deleting attachment ce539b5e-dc89-4dae-acee-8aafedb0edcd. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.312s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:49:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Deleted volume successfully. Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-83f9318f-22a9-45f1-87cf-9f874291a05e tempest-VolumesTransfersV355Test-763949830 None] Lock "cinder-4002b515-bfed-479f-9cb5-5ba0e551f94a-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "cinder-9d8a9819-683a-42b2-a26c-9db8ee305994-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-9d8a9819-683a-42b2-a26c-9db8ee305994-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "cinder-quobyte-9d8a9819-683a-42b2-a26c-9db8ee305994" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-quobyte-9d8a9819-683a-42b2-a26c-9db8ee305994" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd4f414-5d71-4151-a961-8ee3ae1b8e5d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:04 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 Sep 09 03:49:04 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:05 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994" returned: 0 in 0.664s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:05 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994 Sep 09 03:49:05 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:05 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d8a9819-683a-42b2-a26c-9db8ee305994" returned: 0 in 0.348s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-quobyte-9d8a9819-683a-42b2-a26c-9db8ee305994" released by "delete_volume" :: held 1.083s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:05 devstack cinder-volume[87597]: WARNING cinder.quota [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1382207025-1764293848 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1382207025-1764293848, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:49:05 devstack cinder-volume[87597]: WARNING cinder.quota [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1382207025-1764293848 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1382207025-1764293848, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:49:05 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Created reservations ['bb69d399-0fd6-43e1-80e1-6340594473b6', '5ef94df1-a4f0-4bb5-8656-bcf5c468e107', '127c1f05-ef89-473e-9dae-6b5f849f43e2', 'bb583f73-975d-4552-886f-92a8ba031c55'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:06 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:49:06 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:06 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.423s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:49:06 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Deleted volume successfully. Sep 09 03:49:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9fb11614-fde4-4fb9-8d63-3276519789ea tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-9d8a9819-683a-42b2-a26c-9db8ee305994-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-3c3be22e-b2a9-42c8-b8da-7bfd8134d853 req-0c29ddb7-84ad-4183-8ce5-fccf150d32f4 tempest-TestInstancesWithCinderVolumes-464600528 None] Terminate volume connection completed successfully. Sep 09 03:49:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-3c3be22e-b2a9-42c8-b8da-7bfd8134d853 req-0c29ddb7-84ad-4183-8ce5-fccf150d32f4 tempest-TestInstancesWithCinderVolumes-464600528 None] Deleting attachment 0ede9f08-721c-4afc-a9df-9ae3f59662c3. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:49:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "cinder-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "cinder-quobyte-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-quobyte-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1" acquired by "delete_volume" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:10 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f363d3-6aa9-4dd1-9cfc-1ab5b8eef023]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:11 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 Sep 09 03:49:11 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:11 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1" returned: 0 in 0.733s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:11 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1 Sep 09 03:49:11 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:11 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1" returned: 0 in 0.470s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-quobyte-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1" released by "delete_volume" :: held 1.321s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:12 devstack cinder-volume[87597]: WARNING cinder.quota [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991339295-1104420213 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991339295-1104420213, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:49:12 devstack cinder-volume[87597]: WARNING cinder.quota [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991339295-1104420213 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991339295-1104420213, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Created reservations ['c94a7369-baad-4a4d-9dd6-86415a01fdc0', '60de29fc-8e44-409b-a637-c473e81e37fe', '7e0615e2-fb35-4a53-bd01-71d6153069e7', 'c49ddc1c-9696-449d-b624-c0683d2f7bdc'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:12 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:49:12 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:12 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.529s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:49:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Deleted volume successfully. Sep 09 03:49:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-69239db7-d203-44a4-aa27-b31e53ec1b7d tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-c42b4612-dabb-42bd-8af2-9cc9b1e79dc1-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f8a59a82-0cba-4564-ace4-5e606771dcc3 tempest-VolumesActionsTest-1114830499 None] Acquiring lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18" by "attach_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f8a59a82-0cba-4564-ace4-5e606771dcc3 tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18" acquired by "attach_volume" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f8a59a82-0cba-4564-ace4-5e606771dcc3 tempest-VolumesActionsTest-1114830499 None] Attaching volume 32be3ad1-84c0-4971-9a77-580a5f14de18 to instance f467785a-b494-420c-be12-11004070d1fb at mountpoint /dev/vdb on host None. Sep 09 03:49:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f8a59a82-0cba-4564-ace4-5e606771dcc3 tempest-VolumesActionsTest-1114830499 None] Attach volume completed successfully. Sep 09 03:49:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f8a59a82-0cba-4564-ace4-5e606771dcc3 tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18" released by "attach_volume" :: held 0.255s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-db1ec518-88a2-4d36-8972-69ef8020ca7f tempest-VolumesActionsTest-1114830499 None] Acquiring lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-detach_volume" by "detach_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-db1ec518-88a2-4d36-8972-69ef8020ca7f tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-db1ec518-88a2-4d36-8972-69ef8020ca7f tempest-VolumesActionsTest-1114830499 None] Detaching volume 32be3ad1-84c0-4971-9a77-580a5f14de18 from instance f467785a-b494-420c-be12-11004070d1fb. Sep 09 03:49:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-db1ec518-88a2-4d36-8972-69ef8020ca7f tempest-VolumesActionsTest-1114830499 None] Detach volume completed successfully. Sep 09 03:49:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-db1ec518-88a2-4d36-8972-69ef8020ca7f tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Flow 'volume_create_manager' (e970cb88-6e3c-4f92-b8f9-76665bb52e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e9f330-a0b4-4e5b-9672-ee547b7377c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e9f330-a0b4-4e5b-9672-ee547b7377c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-365282360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbae61f-dfeb-4cac-a7c0-aa73359d64e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21501e0ac88d4352b0eefb6282b0b13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:17Z,use_quota=True,user_id='551275c2b9f24186ad7118845ff3fc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118d20d0-25da-4ae9-a766-1d752dd32142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118d20d0-25da-4ae9-a766-1d752dd32142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d5acc0-869b-49ed-b0d5-948654741da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d5acc0-869b-49ed-b0d5-948654741da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cbae61f-dfeb-4cac-a7c0-aa73359d64e6', 'volume_name': 'volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1590d345-262c-400f-bcf5-9fc99a838ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1590d345-262c-400f-bcf5-9fc99a838ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb33fc5-16b7-4b34-898c-21b0d7ee9414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:17 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Volume 4cbae61f-dfeb-4cac-a7c0-aa73359d64e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6', 'volume_size': 1} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-365282360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbae61f-dfeb-4cac-a7c0-aa73359d64e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21501e0ac88d4352b0eefb6282b0b13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:17Z,use_quota=True,user_id='551275c2b9f24186ad7118845ff3fc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Creating volume 4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:49:17 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:49:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:17 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 1073741824 Sep 09 03:49:17 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:18 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 1073741824" returned: 0 in 0.738s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:18 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 Sep 09 03:49:18 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:18 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" returned: 0 in 0.314s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb33fc5-16b7-4b34-898c-21b0d7ee9414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f85a80b-ccb8-4a1d-8bd2-8c3eb464ada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:18 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Volume volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 (4cbae61f-dfeb-4cac-a7c0-aa73359d64e6): created successfully Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f85a80b-ccb8-4a1d-8bd2-8c3eb464ada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Flow 'volume_create_manager' (e970cb88-6e3c-4f92-b8f9-76665bb52e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:18 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b03a5bc4-0781-4233-adef-ccd83e5e16f5 tempest-VolumesCloneTest-448121571 None] Created volume successfully. Sep 09 03:49:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-eb1ce3b2-b04d-4024-bf7d-ad0b5ac003ab req-e6be431a-ce9b-4bb8-b072-d5f50ac4fea4 tempest-TestInstancesWithCinderVolumes-464600528 None] Terminate volume connection completed successfully. Sep 09 03:49:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-eb1ce3b2-b04d-4024-bf7d-ad0b5ac003ab req-e6be431a-ce9b-4bb8-b072-d5f50ac4fea4 tempest-TestInstancesWithCinderVolumes-464600528 None] Deleting attachment 571fff20-2ea1-46a6-9531-54f96f879281. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Flow 'volume_create_manager' (a07da9b2-cf5f-4950-8e84-dee2156dbaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b5f0ed-e8ae-44d7-83f2-81dd1d00f71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b5f0ed-e8ae-44d7-83f2-81dd1d00f71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1044638108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef7ab43-82ee-4987-9d8b-f9d4ce9375d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21501e0ac88d4352b0eefb6282b0b13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4cbae61f-dfeb-4cac-a7c0-aa73359d64e6,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:20Z,use_quota=True,user_id='551275c2b9f24186ad7118845ff3fc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80aeb025-cf5b-4322-8776-a6cb8e3c8440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80aeb025-cf5b-4322-8776-a6cb8e3c8440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d158c010-01a3-407c-bb22-d6552c661088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d158c010-01a3-407c-bb22-d6552c661088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'aef7ab43-82ee-4987-9d8b-f9d4ce9375d8', 'volume_name': 'volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8', 'volume_size': 2, 'source_volid': '4cbae61f-dfeb-4cac-a7c0-aa73359d64e6', 'source_volstatus': 'available'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c7695a-4f88-407e-82af-72727cda6c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c7695a-4f88-407e-82af-72727cda6c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8c5b1c-2656-4e3f-8486-caea55597bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:20 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Volume aef7ab43-82ee-4987-9d8b-f9d4ce9375d8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8', 'volume_size': 2, 'source_volid': '4cbae61f-dfeb-4cac-a7c0-aa73359d64e6', 'source_volstatus': 'available'} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:20 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Cloning volume 4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 to volume aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Creating offline snapshot fe8191a2-9cb2-4761-99d2-93e4929e3ea7 of volume 4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84c478c-5cac-4b4e-bf7e-7f59643a5725]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "cinder-e3e3288f-7c56-485f-a9b1-2796bb4ee217-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:20 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 Sep 09 03:49:20 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-e3e3288f-7c56-485f-a9b1-2796bb4ee217-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "cinder-quobyte-e3e3288f-7c56-485f-a9b1-2796bb4ee217" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-quobyte-e3e3288f-7c56-485f-a9b1-2796bb4ee217" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5cbcb7-e78d-41fb-a09e-55d8d9b57874]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:20 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 Sep 09 03:49:20 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:20 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" returned: 0 in 0.514s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:20 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 1G Sep 09 03:49:20 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:21 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217" returned: 0 in 0.520s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:21 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217 Sep 09 03:49:21 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:21 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 1G" returned: 0 in 0.559s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:21 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 Sep 09 03:49:21 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:21 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3e3288f-7c56-485f-a9b1-2796bb4ee217" returned: 0 in 0.316s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-quobyte-e3e3288f-7c56-485f-a9b1-2796bb4ee217" released by "delete_volume" :: held 0.901s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:21 devstack cinder-volume[87597]: WARNING cinder.quota [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-447771119-532217733 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-447771119-532217733, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:49:21 devstack cinder-volume[87597]: WARNING cinder.quota [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-447771119-532217733 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-447771119-532217733, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Created reservations ['e01e2b01-e518-4633-a15b-eb5f278fd600', '8e5c81f3-25c6-48e3-b5aa-a13a326c54ef', '03cf3ce4-3bec-49d5-a33c-a57a2ba59316', '9d972798-ecf9-4a3b-b7f2-34ccfd7e4c24'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:21 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:49:21 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:21 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7" returned: 0 in 0.476s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:21 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 is being set with open permissions: ugo+rw Sep 09 03:49:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:21 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 Sep 09 03:49:21 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:22 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.498s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:22 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:49:22 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Deleted volume successfully. Sep 09 03:49:22 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7" returned: 0 in 0.412s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3bc3b4cc-325c-4a16-8268-a846e0e14bd2 tempest-TestInstancesWithCinderVolumes-464600528 None] Lock "cinder-e3e3288f-7c56-485f-a9b1-2796bb4ee217-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:22 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.info Sep 09 03:49:22 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:22 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.info" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:22 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.info is being set with open permissions: ugo+rw Sep 09 03:49:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:22 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.info Sep 09 03:49:22 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:23 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.info" returned: 0 in 0.540s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Acquiring lock "cinder-quobyte-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Lock "cinder-quobyte-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] snapshot: fe8191a2-9cb2-4761-99d2-93e4929e3ea7, volume: aef7ab43-82ee-4987-9d8b-f9d4ce9375d8, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ab7435-b0e5-4068-b04e-fa1055fcf10c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:23 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 Sep 09 03:49:23 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:23 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7" returned: 0 in 0.466s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46036ee-f9e9-447c-b842-35e5bbe68fff]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:24 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 Sep 09 03:49:24 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:24 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" returned: 0 in 0.598s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:49:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:49:24 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:49:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:24 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 Sep 09 03:49:24 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Flow 'volume_create_manager' (d543e68b-fd2c-4130-b4ea-180351cf7297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad76686e-ceff-4d48-8030-2877a284dcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad76686e-ceff-4d48-8030-2877a284dcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-743331468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c3ca1d-170c-4a1c-846a-afa07b99059a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507b42167808464c9315d3da3a1523cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:25Z,use_quota=True,user_id='70f5fa677a83459bb036b671da9b567f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6b2c54-fe47-4866-a630-97d940b7a1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6b2c54-fe47-4866-a630-97d940b7a1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa191404-f65d-4635-b939-fe3b424ea54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa191404-f65d-4635-b939-fe3b424ea54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c3ca1d-170c-4a1c-846a-afa07b99059a', 'volume_name': 'volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0d5856-2a59-4e5d-9d50-eb8f6decc2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0d5856-2a59-4e5d-9d50-eb8f6decc2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77d3ed6-f658-49c9-932e-0b6688883400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:25 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Volume b4c3ca1d-170c-4a1c-846a-afa07b99059a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a', 'volume_size': 1} Sep 09 03:49:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6a862cf4-8f8a-4585-a425-19a01e45401c tempest-VolumesActionsTest-1114830499 None] Acquiring lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18" by "attach_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6a862cf4-8f8a-4585-a425-19a01e45401c tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18" acquired by "attach_volume" :: waited 0.063s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6a862cf4-8f8a-4585-a425-19a01e45401c tempest-VolumesActionsTest-1114830499 None] Attaching volume 32be3ad1-84c0-4971-9a77-580a5f14de18 to instance f147ed37-4e76-404b-a603-b76f19f8c689 at mountpoint /dev/vdb on host None. Sep 09 03:49:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6a862cf4-8f8a-4585-a425-19a01e45401c tempest-VolumesActionsTest-1114830499 None] Attach volume completed successfully. Sep 09 03:49:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6a862cf4-8f8a-4585-a425-19a01e45401c tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18" released by "attach_volume" :: held 0.364s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:31 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" returned: 0 in 7.392s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:31 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:49:31 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Converted 1024.00 MB image at 138.50 MB/s Sep 09 03:49:31 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 is being set with open permissions: ugo+rw Sep 09 03:49:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:31 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 Sep 09 03:49:31 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:32 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" returned: 0 in 0.336s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-182a638b-fdbc-4c82-bc0f-2969818f14c8 tempest-VolumesActionsTest-1114830499 None] Acquiring lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-detach_volume" by "detach_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Lock "cinder-quobyte-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" released by "_copy_volume_from_snapshot" :: held 8.933s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Acquiring lock "cinder-quobyte-fe8191a2-9cb2-4761-99d2-93e4929e3ea7" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-182a638b-fdbc-4c82-bc0f-2969818f14c8 tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-182a638b-fdbc-4c82-bc0f-2969818f14c8 tempest-VolumesActionsTest-1114830499 None] Detaching volume 32be3ad1-84c0-4971-9a77-580a5f14de18 from instance f147ed37-4e76-404b-a603-b76f19f8c689. Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Lock "cinder-quobyte-fe8191a2-9cb2-4761-99d2-93e4929e3ea7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Deleting offline snapshot fe8191a2-9cb2-4761-99d2-93e4929e3ea7 of volume 4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] snapshot_file for this snap is: volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6c768a-b047-4df3-aca2-b7f458d3cab9]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-182a638b-fdbc-4c82-bc0f-2969818f14c8 tempest-VolumesActionsTest-1114830499 None] Detach volume completed successfully. Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-182a638b-fdbc-4c82-bc0f-2969818f14c8 tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:32 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 Sep 09 03:49:32 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:32 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7" returned: 0 in 0.485s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5948c5f1-cede-4c0b-8db5-f25652a77360]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:32 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 Sep 09 03:49:32 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:33 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" returned: 0 in 0.764s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:33 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 Sep 09 03:49:33 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:34 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7" returned: 0 in 0.466s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:34 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7 Sep 09 03:49:34 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:34 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6.fe8191a2-9cb2-4761-99d2-93e4929e3ea7" returned: 0 in 0.415s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Lock "cinder-quobyte-fe8191a2-9cb2-4761-99d2-93e4929e3ea7" released by "_delete_snapshot" :: held 2.250s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=127,cinder:SELECT=136,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.349s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.402s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-743331468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c3ca1d-170c-4a1c-846a-afa07b99059a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507b42167808464c9315d3da3a1523cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:25Z,use_quota=True,user_id='70f5fa677a83459bb036b671da9b567f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Creating volume b4c3ca1d-170c-4a1c-846a-afa07b99059a {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:49:34 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:34 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a 1073741824 Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8c5b1c-2656-4e3f-8486-caea55597bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8', 'volume_size': 2, 'source_volid': '4cbae61f-dfeb-4cac-a7c0-aa73359d64e6', 'source_volstatus': 'available'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:34 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e24bea-cec1-4696-8726-d9270979f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:34 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Volume volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 (aef7ab43-82ee-4987-9d8b-f9d4ce9375d8): created successfully Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e24bea-cec1-4696-8726-d9270979f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Flow 'volume_create_manager' (a07da9b2-cf5f-4950-8e84-dee2156dbaa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:34 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cf101d33-1848-4437-a99c-4f91a0555078 tempest-VolumesCloneTest-448121571 None] Created volume successfully. Sep 09 03:49:35 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a 1073741824" returned: 0 in 0.479s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:35 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a Sep 09 03:49:35 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Acquiring lock "cinder-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Lock "cinder-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Acquiring lock "cinder-quobyte-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Lock "cinder-quobyte-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f001e74-30ae-4d4d-9f84-78bb39a97969]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:35 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a" returned: 0 in 0.429s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:35 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 Sep 09 03:49:35 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77d3ed6-f658-49c9-932e-0b6688883400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6b32b9-2e12-48c8-85f5-0d432bc391a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:35 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Volume volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a (b4c3ca1d-170c-4a1c-846a-afa07b99059a): created successfully Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6b32b9-2e12-48c8-85f5-0d432bc391a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Flow 'volume_create_manager' (d543e68b-fd2c-4130-b4ea-180351cf7297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2775c665-60a0-4532-88b8-a1b6c7035302 tempest-VolumesTransfersTest-187280449 None] Created volume successfully. Sep 09 03:49:35 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" returned: 0 in 0.436s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:35 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8 Sep 09 03:49:35 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:36 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" returned: 0 in 0.301s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Lock "cinder-quobyte-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8" released by "delete_volume" :: held 0.828s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Created reservations ['78652d18-1192-4a23-bc18-2de58709ae45', '3d9ae081-dfd7-43dc-8f9b-4945e54e0eca', '7546d447-b088-4313-89fd-495eb50bf662', '87b3ad93-ebfc-4d96-b7e5-4b5fc024ebc5'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:36 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:49:36 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Acquiring lock "cinder-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Lock "cinder-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Acquiring lock "cinder-quobyte-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Lock "cinder-quobyte-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:36 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.372s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc13c4c-bd73-4931-b40b-80d4a11b37b4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:36 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Deleted volume successfully. Sep 09 03:49:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3080ed36-ed26-498a-b29d-eaab635e7b85 tempest-VolumesCloneTest-448121571 None] Lock "cinder-aef7ab43-82ee-4987-9d8b-f9d4ce9375d8-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:36 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 Sep 09 03:49:36 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:37 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" returned: 0 in 0.514s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:37 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6 Sep 09 03:49:37 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:37 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:49:37 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e96570-5280-4d42-9447-6f4f866cd7b0]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:37 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8af3cf29-ade0-43e6-8aa8-cee9087edd8d tempest-VolumesTransfersTest-235612322 None] Transfer volume completed successfully. Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" returned: 0 in 0.424s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:37 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.396s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Lock "cinder-quobyte-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6" released by "delete_volume" :: held 1.026s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:37 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:49:37 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Created reservations ['ba8a3e8d-88d9-425f-8795-f8edcacd7970', '23d66410-9db9-4c9b-b030-bce38aaf7aaa', 'e42e46ad-623d-435d-bfb7-f0aceb0fee0f', '8de6c6ea-7c6e-4968-966b-dc37d806ea16'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:37 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:49:37 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:38 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.508s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c98c267-7596-4d4e-8757-119f3af834f0]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:38 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:49:38 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:38 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.425s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:49:38 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Deleted volume successfully. Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3c6cd2e1-e0d6-4b9a-b4f1-79ef724efe14 tempest-VolumesCloneTest-448121571 None] Lock "cinder-4cbae61f-dfeb-4cac-a7c0-aa73359d64e6-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Acquiring lock "cinder-b4c3ca1d-170c-4a1c-846a-afa07b99059a-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Lock "cinder-b4c3ca1d-170c-4a1c-846a-afa07b99059a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Acquiring lock "cinder-quobyte-b4c3ca1d-170c-4a1c-846a-afa07b99059a" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Lock "cinder-quobyte-b4c3ca1d-170c-4a1c-846a-afa07b99059a" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f4f89b-7fc4-486f-89f4-33bb2270a0ee]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:38 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.585s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.9116c0ea-6c79-4c95-b1db-98134b0d889ed2031mlr.img {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:38 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.9116c0ea-6c79-4c95-b1db-98134b0d889ed2031mlr.img Sep 09 03:49:38 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:38 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a Sep 09 03:49:38 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:39 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a" returned: 0 in 0.570s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:39 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a Sep 09 03:49:39 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:39 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b4c3ca1d-170c-4a1c-846a-afa07b99059a" returned: 0 in 0.471s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Lock "cinder-quobyte-b4c3ca1d-170c-4a1c-846a-afa07b99059a" released by "delete_volume" :: held 1.104s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:39 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=137,cinder:DELETE=12,cinder:SELECT=101,cinder:INSERT=26 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:49:39 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Created reservations ['011433fa-5428-4e0a-a417-84a4e6d5ac85', 'a2350927-5df8-463b-9f97-4e11d3db480e', '615d72fe-d3c6-4d64-a415-8d68bb8ea762', '4dd32529-6d12-4105-a5a2-bc0c4932a4aa'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:40 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:49:40 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:40 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.534s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:49:40 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Deleted volume successfully. Sep 09 03:49:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-99d29ae1-543c-49c6-ae8b-035f7186ec2f tempest-VolumesTransfersTest-663683547 None] Lock "cinder-b4c3ca1d-170c-4a1c-846a-afa07b99059a-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Flow 'volume_create_manager' (bd08927f-c503-4e3d-9518-41d0c2b054ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d216a11-1079-47f6-a7ff-7d54f2f1dde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d216a11-1079-47f6-a7ff-7d54f2f1dde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1055593205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debea495-c53e-422b-b8a2-ac149979c8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507b42167808464c9315d3da3a1523cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:43Z,use_quota=True,user_id='70f5fa677a83459bb036b671da9b567f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857560ce-1710-47c8-978c-552356573123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857560ce-1710-47c8-978c-552356573123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638deed8-d312-4186-93c2-5aa591a9a7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638deed8-d312-4186-93c2-5aa591a9a7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'debea495-c53e-422b-b8a2-ac149979c8b0', 'volume_name': 'volume-debea495-c53e-422b-b8a2-ac149979c8b0', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a59b591-c6e6-4da7-a8dc-09d579cb7484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a59b591-c6e6-4da7-a8dc-09d579cb7484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f842e8-bc1a-4a3d-a802-4cc690f70787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:42 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Volume debea495-c53e-422b-b8a2-ac149979c8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-debea495-c53e-422b-b8a2-ac149979c8b0', 'volume_size': 1} Sep 09 03:49:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:44 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.9116c0ea-6c79-4c95-b1db-98134b0d889ed2031mlr.img" returned: 0 in 5.815s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:44 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2e673f-7873-4dc6-b1f9-4c92ff1043e8]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:49:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:49:44 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:49:44 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:49:45 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 09 03:49:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.598s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:49:45 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.9116c0ea-6c79-4c95-b1db-98134b0d889ed2031mlr.img {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:49:45 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Converted 1024.00 MB image at 176.08 MB/s Sep 09 03:49:45 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] 9116c0ea-6c79-4c95-b1db-98134b0d889e was raw, no need to convert to raw {{(pid=87597) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Flow 'volume_create_manager' (c228bd33-b209-4542-b17e-8c6cdebf94d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97c6f7b-7566-4edc-b233-4204b08df7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97c6f7b-7566-4edc-b233-4204b08df7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-414639098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03089176-5aa9-44cd-b5dc-08149c2ea9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da9708a28044f59bedc62e604a22769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:47Z,use_quota=True,user_id='b33b2feb0a7d4f3b99f26724074859a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66d067d-3e2f-47d4-bfcd-425caf97a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66d067d-3e2f-47d4-bfcd-425caf97a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d57348a-c7f0-43cf-9fdf-197d31ec2ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d57348a-c7f0-43cf-9fdf-197d31ec2ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03089176-5aa9-44cd-b5dc-08149c2ea9ad', 'volume_name': 'volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad', 'volume_size': 2}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3a4d8c-e991-4451-878f-ad9c9c64c5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3a4d8c-e991-4451-878f-ad9c9c64c5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddffda3-a634-4468-97d4-26e22d078870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:49:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Volume 03089176-5aa9-44cd-b5dc-08149c2ea9ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad', 'volume_size': 2} Sep 09 03:49:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:49:57 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:INSERT=3,cinder:UPDATE=10,cinder:SELECT=5 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:49:57 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=29,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.632s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Uploaded volume to glance image-id: 9116c0ea-6c79-4c95-b1db-98134b0d889e. {{(pid=87597) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.234s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1055593205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debea495-c53e-422b-b8a2-ac149979c8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507b42167808464c9315d3da3a1523cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:43Z,use_quota=True,user_id='70f5fa677a83459bb036b671da9b567f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Creating volume debea495-c53e-422b-b8a2-ac149979c8b0 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:50:07 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:07 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 1073741824 Sep 09 03:50:07 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4c83fa52-54b7-4f01-ac30-c2a81cd98ab7 tempest-VolumesActionsTest-1114830499 None] Copy volume to image completed successfully. Sep 09 03:50:07 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 1073741824" returned: 0 in 0.513s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:07 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 Sep 09 03:50:07 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:08 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0" returned: 0 in 0.297s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.663s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-414639098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03089176-5aa9-44cd-b5dc-08149c2ea9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9da9708a28044f59bedc62e604a22769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:49:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:49:47Z,use_quota=True,user_id='b33b2feb0a7d4f3b99f26724074859a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Creating volume 03089176-5aa9-44cd-b5dc-08149c2ea9ad {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:50:08 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad 2147483648 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f842e8-bc1a-4a3d-a802-4cc690f70787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-debea495-c53e-422b-b8a2-ac149979c8b0', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:08 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad 2147483648 Sep 09 03:50:08 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9c863e-008c-41a9-bc6e-484af44b9425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:08 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Volume volume-debea495-c53e-422b-b8a2-ac149979c8b0 (debea495-c53e-422b-b8a2-ac149979c8b0): created successfully Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9c863e-008c-41a9-bc6e-484af44b9425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Flow 'volume_create_manager' (bd08927f-c503-4e3d-9518-41d0c2b054ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4ce0aaca-d430-42e6-a7a6-d736b9fbbd76 tempest-VolumesTransfersTest-187280449 None] Created volume successfully. Sep 09 03:50:08 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad 2147483648" returned: 0 in 0.725s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:08 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad Sep 09 03:50:08 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Acquiring lock "cinder-debea495-c53e-422b-b8a2-ac149979c8b0-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Lock "cinder-debea495-c53e-422b-b8a2-ac149979c8b0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Acquiring lock "cinder-quobyte-debea495-c53e-422b-b8a2-ac149979c8b0" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Lock "cinder-quobyte-debea495-c53e-422b-b8a2-ac149979c8b0" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8bb463-5ac4-466c-9517-ba764ee4cca5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:09 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad" returned: 0 in 0.349s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:50:09 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:09 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.182s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddffda3-a634-4468-97d4-26e22d078870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad', 'volume_size': 2}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b204d3-2ae6-4d5a-891b-4a8cb431bcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e8e40a-cf4a-4ce4-8971-65a15500799c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:09 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Volume volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad (03089176-5aa9-44cd-b5dc-08149c2ea9ad): created successfully Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b204d3-2ae6-4d5a-891b-4a8cb431bcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Flow 'volume_create_manager' (c228bd33-b209-4542-b17e-8c6cdebf94d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2a36af6f-8b53-4515-ad62-ad66c9a8db88 tempest-VolumesCloneNegativeTest-1342206783 None] Created volume successfully. Sep 09 03:50:09 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:50:09 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:09 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0" returned: 0 in 0.520s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:09 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0 Sep 09 03:50:09 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:09 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.441s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0479c7a8-897a-4df8-9323-38bdee832e02]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:09 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:50:09 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:09 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-debea495-c53e-422b-b8a2-ac149979c8b0" returned: 0 in 0.326s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Lock "cinder-quobyte-debea495-c53e-422b-b8a2-ac149979c8b0" released by "delete_volume" :: held 0.893s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Created reservations ['dab2f1f2-e91b-48fd-a568-334806d35f60', '63748efb-8126-42ac-b96c-2b14d0e00a25', '8ea0ff89-6019-4dea-8a89-b4461b0bbe79', '93a72838-2fc8-42bb-9781-c1376aae16b8'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:10 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:50:10 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Acquiring lock "cinder-03089176-5aa9-44cd-b5dc-08149c2ea9ad-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "cinder-03089176-5aa9-44cd-b5dc-08149c2ea9ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:10 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.625s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Acquiring lock "cinder-quobyte-03089176-5aa9-44cd-b5dc-08149c2ea9ad" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "cinder-quobyte-03089176-5aa9-44cd-b5dc-08149c2ea9ad" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:10 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img Sep 09 03:50:10 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3169aa-d53d-4c23-b06f-71104d6ee687]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:10 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.506s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:50:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Deleted volume successfully. Sep 09 03:50:10 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad Sep 09 03:50:10 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5f1f81f8-52cb-434f-a1ce-96b9b693a0ec tempest-VolumesTransfersTest-663683547 None] Lock "cinder-debea495-c53e-422b-b8a2-ac149979c8b0-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:11 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad" returned: 0 in 0.802s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:11 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad Sep 09 03:50:11 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:12 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-03089176-5aa9-44cd-b5dc-08149c2ea9ad" returned: 0 in 0.777s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "cinder-quobyte-03089176-5aa9-44cd-b5dc-08149c2ea9ad" released by "delete_volume" :: held 1.691s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Created reservations ['d24025a6-422a-4df5-9fd3-219758f3c61c', '54210685-47b1-4fb0-8714-aad4a6512063', '94e9f714-3d62-4bf6-9612-b77dc94bc921', '80770baa-1240-47e5-b475-5d2589d2db66'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:12 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:50:12 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:13 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.531s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:13 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:50:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Deleted volume successfully. Sep 09 03:50:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-471cfa17-f2d1-42f9-a5bc-ac5004676af6 tempest-VolumesCloneNegativeTest-1342206783 None] Lock "cinder-03089176-5aa9-44cd-b5dc-08149c2ea9ad-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:15 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img" returned: 0 in 5.596s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32e487f-6f6e-4fe5-8e7d-f8658678c739]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:16 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:50:16 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:16 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.634s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:16 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:50:16 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Converted 1024.00 MB image at 182.96 MB/s Sep 09 03:50:16 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] ba1bd60c-283c-4c88-8f5e-89a55c00ef92 was raw, converting to qcow2 {{(pid=87597) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 09 03:50:16 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bc8adf-b8bf-405e-95b6-095d26280c74]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:16 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img Sep 09 03:50:16 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:17 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img" returned: 0 in 0.400s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:17 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img Sep 09 03:50:17 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:17 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img" returned: 1 in 0.501s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img /opt/stack/data/cinder/conversion/vol_upload_3l65kgwi {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:17 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img /opt/stack/data/cinder/conversion/vol_upload_3l65kgwi Sep 09 03:50:17 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:17 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img /opt/stack/data/cinder/conversion/vol_upload_3l65kgwi" returned: 0 in 0.362s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Image conversion details: src /opt/stack/data/cinder/conversion/32be3ad1-84c0-4971-9a77-580a5f14de18.temp_image.ba1bd60c-283c-4c88-8f5e-89a55c00ef92anxdwnuy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3l65kgwi {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:50:17 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[48be9eee-90ea-41a0-b467-a2c5758c6332]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3l65kgwi {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:18 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3l65kgwi Sep 09 03:50:18 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:18 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3l65kgwi" returned: 0 in 0.537s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.044s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Uploaded volume to glance image-id: ba1bd60c-283c-4c88-8f5e-89a55c00ef92. {{(pid=87597) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 03:50:20 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-336eacf0-651c-4120-a00a-ae9c03fe9d30 tempest-VolumesActionsTest-1114830499 None] Copy volume to image completed successfully. Sep 09 03:50:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Acquiring lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Acquiring lock "cinder-quobyte-32be3ad1-84c0-4971-9a77-580a5f14de18" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Lock "cinder-quobyte-32be3ad1-84c0-4971-9a77-580a5f14de18" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:21 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf106f07-dac7-4d46-b55c-28c026fd9a8e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:21 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:50:21 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:22 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.464s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:22 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18 Sep 09 03:50:22 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:22 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-32be3ad1-84c0-4971-9a77-580a5f14de18" returned: 0 in 0.354s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Lock "cinder-quobyte-32be3ad1-84c0-4971-9a77-580a5f14de18" released by "delete_volume" :: held 0.869s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Created reservations ['8878653c-91fd-4be9-904e-2c4410b48e2e', '41df31c2-1b4f-4e89-9b76-af7f7dbcc718', '061feaa4-ec2e-484d-8c89-9ccb68c45598', 'ac748933-6ad6-4e0b-a0a8-65233255c792'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:22 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:50:22 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:23 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.407s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:50:23 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Deleted volume successfully. Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fbab24de-18d1-4426-be5f-1f49b2c6eb7a tempest-VolumesActionsTest-1114830499 None] Lock "cinder-32be3ad1-84c0-4971-9a77-580a5f14de18-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Flow 'volume_create_manager' (277a6928-16e3-46ca-bdc0-ab6f3eeb2fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07930614-bc23-4c6d-80a1-e2f0389e08b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07930614-bc23-4c6d-80a1-e2f0389e08b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-931945023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d81308-1614-4f7c-9f03-9aefda3e3053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e1e4d01cc149a395c7bd575aec217b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:23Z,use_quota=True,user_id='686d5d4789fa465ab950f9bb76c9d51c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2879c693-3e42-4b98-92af-1a404b23585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2879c693-3e42-4b98-92af-1a404b23585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c709f1e8-4ebb-4b64-83e2-aeade69bcde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c709f1e8-4ebb-4b64-83e2-aeade69bcde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d81308-1614-4f7c-9f03-9aefda3e3053', 'volume_name': 'volume-b3d81308-1614-4f7c-9f03-9aefda3e3053', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e6663b-1024-47ab-87d8-6334dd8246a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e6663b-1024-47ab-87d8-6334dd8246a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915b4524-a48d-405a-acd9-a1a3d3fbc478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:23 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Volume b3d81308-1614-4f7c-9f03-9aefda3e3053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d81308-1614-4f7c-9f03-9aefda3e3053', 'volume_size': 1} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-931945023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d81308-1614-4f7c-9f03-9aefda3e3053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e1e4d01cc149a395c7bd575aec217b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:23Z,use_quota=True,user_id='686d5d4789fa465ab950f9bb76c9d51c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Creating volume b3d81308-1614-4f7c-9f03-9aefda3e3053 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:50:23 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:50:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:23 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 1073741824 Sep 09 03:50:23 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:24 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 1073741824" returned: 0 in 0.594s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:24 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 Sep 09 03:50:24 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:24 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053" returned: 0 in 0.351s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915b4524-a48d-405a-acd9-a1a3d3fbc478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d81308-1614-4f7c-9f03-9aefda3e3053', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ca18d2-1a63-41cb-9e95-dbaf6fa63ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:24 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Volume volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 (b3d81308-1614-4f7c-9f03-9aefda3e3053): created successfully Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ca18d2-1a63-41cb-9e95-dbaf6fa63ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Flow 'volume_create_manager' (277a6928-16e3-46ca-bdc0-ab6f3eeb2fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:24 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8b28b900-ed8a-4c3f-9ea8-58ee3038b8ee tempest-VolumesNegativeTest-1955354095 None] Created volume successfully. Sep 09 03:50:34 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=28,cinder:UPDATE=34,cinder:INSERT=7 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:50:34 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=15,cinder:UPDATE=32,cinder:DELETE=6,cinder:INSERT=8 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (3a07fe81-010d-4e32-9e32-17a7edbd1247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ded9c42-ee1d-417c-af4e-f26ebec43c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ded9c42-ee1d-417c-af4e-f26ebec43c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1804825247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf5cbf2-7b6b-4d77-8e59-abd29d66afac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41ca0f217747859366ee93bb6e661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:37Z,use_quota=True,user_id='188900cdb7824245b5a073527ee54418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:37 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:50:37 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f9545d-8950-4c80-a79a-01c6caee4b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f9545d-8950-4c80-a79a-01c6caee4b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fada1c29-b6d1-4b53-b118-0d4b73d46cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fada1c29-b6d1-4b53-b118-0d4b73d46cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf5cbf2-7b6b-4d77-8e59-abd29d66afac', 'volume_name': 'volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b20386-9620-4772-b2b3-0447e38bbe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b20386-9620-4772-b2b3-0447e38bbe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e596e1ab-730d-4958-b34f-0345360f3639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Volume 8bf5cbf2-7b6b-4d77-8e59-abd29d66afac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac', 'volume_size': 1} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1804825247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf5cbf2-7b6b-4d77-8e59-abd29d66afac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41ca0f217747859366ee93bb6e661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:37Z,use_quota=True,user_id='188900cdb7824245b5a073527ee54418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Creating volume 8bf5cbf2-7b6b-4d77-8e59-abd29d66afac {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:50:37 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:37 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac 1073741824 Sep 09 03:50:37 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Flow 'volume_create_manager' (6995883f-7f1c-430e-8620-5c112c440109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86420d9d-da80-470d-82c0-d926d8d2da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86420d9d-da80-470d-82c0-d926d8d2da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1840023055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d28de4-ad4c-4208-8e12-4b962afb06d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a728985ce734f249b3386ade1c5b8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:38Z,use_quota=True,user_id='2d996fce4c1547eeb7021b154422c191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98b003f-ebd8-4291-8453-92d1fc621eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98b003f-ebd8-4291-8453-92d1fc621eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60801e57-093b-4f9c-a870-206f226057f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:37 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:50:38 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.689s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60801e57-093b-4f9c-a870-206f226057f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9d28de4-ad4c-4208-8e12-4b962afb06d8', 'volume_name': 'volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29475632-64f3-4b3f-b121-ab31bc72bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29475632-64f3-4b3f-b121-ab31bc72bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59df554a-35fd-43a9-9445-cc30dc305009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Volume d9d28de4-ad4c-4208-8e12-4b962afb06d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Trying to clone d9d28de4-ad4c-4208-8e12-4b962afb06d8 from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f at location (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:50:38 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac 1073741824" returned: 0 in 0.760s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:38 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac Sep 09 03:50:38 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:39 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:50:39 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Image download 20.69 MB at 20.69 MB/s Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" returned: 0 in 0.636s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e596e1ab-730d-4958-b34f-0345360f3639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c970be-471a-4d32-9669-5480e217ad53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Volume volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac (8bf5cbf2-7b6b-4d77-8e59-abd29d66afac): created successfully Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c970be-471a-4d32-9669-5480e217ad53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (3a07fe81-010d-4e32-9e32-17a7edbd1247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad17a18-d509-4118-87c9-73a2a0772757]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-772b204f-6aa9-4429-b797-b764579633c6 tempest-VolumesSnapshotTestJSON-879596971 None] Created volume successfully. Sep 09 03:50:39 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD Sep 09 03:50:39 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:39 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f is fetched for user 2d996fce4c1547eeb7021b154422c191. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68d009c-f7e7-4c65-a33d-94b3f38aa4bc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:40 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD Sep 09 03:50:40 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:40 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1840023055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d28de4-ad4c-4208-8e12-4b962afb06d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a728985ce734f249b3386ade1c5b8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:38Z,use_quota=True,user_id='2d996fce4c1547eeb7021b154422c191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Creating volume d9d28de4-ad4c-4208-8e12-4b962afb06d8 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:50:40 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:50:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:40 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 1073741824 Sep 09 03:50:40 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:41 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 1073741824" returned: 0 in 1.309s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:41 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 Sep 09 03:50:41 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:42 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8" returned: 0 in 0.452s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.492s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Creating offline snapshot 67e03e14-7488-4bd2-95ba-cfab40ffad83 of volume 8bf5cbf2-7b6b-4d77-8e59-abd29d66afac {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Attempting download of 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume d9d28de4-ad4c-4208-8e12-4b962afb06d8. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0310b54-c37e-4e53-b1ca-a8b66309d7ad]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa64ada0-bdd8-423c-8b5e-6e45ba771121]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_bugv3l4q {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:42 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac Sep 09 03:50:42 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:42 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_bugv3l4q Sep 09 03:50:42 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:42 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_bugv3l4q" returned: 0 in 0.520s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_bugv3l4q {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:42 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" returned: 0 in 0.675s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:43 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 1G Sep 09 03:50:43 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:43 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_bugv3l4q Sep 09 03:50:43 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:43 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_bugv3l4q" returned: 1 in 0.633s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_bugv3l4q' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1015b23a-74b5-47b9-a326-b4c935bacb20]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:43 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 1G" returned: 0 in 0.604s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:43 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 Sep 09 03:50:43 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:43 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD Sep 09 03:50:43 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:43 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83" returned: 0 in 0.337s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:43 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 is being set with open permissions: ugo+rw Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:43 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 Sep 09 03:50:43 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:43 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f was qcow2, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:50:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:44 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 Sep 09 03:50:44 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:44 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83" returned: 0 in 0.417s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:44 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.info Sep 09 03:50:44 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:44 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.info" returned: 0 in 0.490s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:44 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.info is being set with open permissions: ugo+rw Sep 09 03:50:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:44 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.info Sep 09 03:50:44 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.info" returned: 0 in 0.527s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:45 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.309s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fb1fb6f9-83dd-4602-bdc2-9bf830af1b01 tempest-VolumesSnapshotTestJSON-879596971 None] Create snapshot completed successfully Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-67e03e14-7488-4bd2-95ba-cfab40ffad83-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-67e03e14-7488-4bd2-95ba-cfab40ffad83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-67e03e14-7488-4bd2-95ba-cfab40ffad83" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-67e03e14-7488-4bd2-95ba-cfab40ffad83" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Deleting offline snapshot 67e03e14-7488-4bd2-95ba-cfab40ffad83 of volume 8bf5cbf2-7b6b-4d77-8e59-abd29d66afac {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] snapshot_file for this snap is: volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e888f2-ca51-4dc2-9c13-222bbfdd8421]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:46 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 Sep 09 03:50:46 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:47 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8" returned: 0 in 3.092s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_9jacjomkdevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:50:47 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Converted 112.00 MB image at 36.18 MB/s Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:47 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 1G Sep 09 03:50:47 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:47 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83" returned: 0 in 0.512s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b286221-5448-4ce7-b0a4-12f42de9b6a5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:47 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac Sep 09 03:50:47 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:47 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 1G" returned: 0 in 0.410s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Downloaded image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume d9d28de4-ad4c-4208-8e12-4b962afb06d8 successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f for user 2d996fce4c1547eeb7021b154422c191 is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Marking volume d9d28de4-ad4c-4208-8e12-4b962afb06d8 as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Copying metadata from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f to d9d28de4-ad4c-4208-8e12-4b962afb06d8. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Creating volume glance metadata for volume d9d28de4-ad4c-4208-8e12-4b962afb06d8 backed by image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59df554a-35fd-43a9-9445-cc30dc305009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04801904-b6dc-4438-b92a-94a6fa71bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Volume volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 (d9d28de4-ad4c-4208-8e12-4b962afb06d8): created successfully Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04801904-b6dc-4438-b92a-94a6fa71bae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Flow 'volume_create_manager' (6995883f-7f1c-430e-8620-5c112c440109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:47 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1f14cf34-adf6-4595-93e7-c2bcd7216eda tempest-VolumesExtendTest-1634297353 None] Created volume successfully. Sep 09 03:50:47 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" returned: 0 in 0.548s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:47 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 Sep 09 03:50:47 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f7ab762-4188-4249-b98c-4738a49f9759 tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f7ab762-4188-4249-b98c-4738a49f9759 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[910aab31-143e-41c0-85ec-ce822b0652f1]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f7ab762-4188-4249-b98c-4738a49f9759 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:48 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 Sep 09 03:50:48 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:48 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83" returned: 0 in 0.584s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:48 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83 Sep 09 03:50:48 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:48 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f7ab762-4188-4249-b98c-4738a49f9759 tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8" returned: 0 in 0.488s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f7ab762-4188-4249-b98c-4738a49f9759 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 2G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f7ab762-4188-4249-b98c-4738a49f9759 tempest-VolumesExtendTest-1634297353 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 2G" returned: 0 in 0.111s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f7ab762-4188-4249-b98c-4738a49f9759 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.650s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1f7ab762-4188-4249-b98c-4738a49f9759 tempest-VolumesExtendTest-1634297353 None] Extend volume completed successfully. Sep 09 03:50:48 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac.67e03e14-7488-4bd2-95ba-cfab40ffad83" returned: 0 in 0.403s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-67e03e14-7488-4bd2-95ba-cfab40ffad83" released by "_delete_snapshot" :: held 2.247s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" released by "delete_snapshot" :: held 2.327s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Created reservations ['376be122-8803-4c50-9507-a38dee44d060', '99a628f6-fa48-4fe9-b48d-7de21d475b2f', '4188e638-361b-4846-b226-68d66bf8b7d4', 'acb2508a-0240-43cd-a4d1-2112414527b5'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:50:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Delete snapshot completed successfully. Sep 09 03:50:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fdda43a3-8bbd-4880-9114-dd1d3591af5a tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-67e03e14-7488-4bd2-95ba-cfab40ffad83-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Acquiring lock "cinder-d9d28de4-ad4c-4208-8e12-4b962afb06d8-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Lock "cinder-d9d28de4-ad4c-4208-8e12-4b962afb06d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Acquiring lock "cinder-quobyte-d9d28de4-ad4c-4208-8e12-4b962afb06d8" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Lock "cinder-quobyte-d9d28de4-ad4c-4208-8e12-4b962afb06d8" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743e7b2-23cd-4aa3-b553-1e24090b976c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:49 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 Sep 09 03:50:49 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:49 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8" returned: 0 in 0.421s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:49 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8 Sep 09 03:50:49 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (02c02c53-3c4b-4635-a7de-a27713a2eab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bacfb0-b0c2-49fb-9f20-d98c70704787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bacfb0-b0c2-49fb-9f20-d98c70704787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-910726898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4be002-c057-40f7-b574-273a6eef3d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41ca0f217747859366ee93bb6e661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:50Z,use_quota=True,user_id='188900cdb7824245b5a073527ee54418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1c06a7-54f6-4191-a85f-4469d6579d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1c06a7-54f6-4191-a85f-4469d6579d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8cd6ad-50d6-4b24-b11a-ffc89ceddbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8cd6ad-50d6-4b24-b11a-ffc89ceddbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4be002-c057-40f7-b574-273a6eef3d0a', 'volume_name': 'volume-9d4be002-c057-40f7-b574-273a6eef3d0a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0b87f5-ff28-439c-8554-5be7e703f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0b87f5-ff28-439c-8554-5be7e703f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ce7aea-7174-47a1-bfde-d3bb49a9f514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:50 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Volume 9d4be002-c057-40f7-b574-273a6eef3d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4be002-c057-40f7-b574-273a6eef3d0a', 'volume_size': 1} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-910726898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4be002-c057-40f7-b574-273a6eef3d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41ca0f217747859366ee93bb6e661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:50Z,use_quota=True,user_id='188900cdb7824245b5a073527ee54418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Creating volume 9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:50 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:50:50 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d9d28de4-ad4c-4208-8e12-4b962afb06d8" returned: 0 in 0.290s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Lock "cinder-quobyte-d9d28de4-ad4c-4208-8e12-4b962afb06d8" released by "delete_volume" :: held 0.760s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:50 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a 1073741824 Sep 09 03:50:50 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Created reservations ['d3e18a23-d246-427c-b463-eb11cbd3dc9e', '6ff1f834-3344-46c3-96e7-b81f2a95234c', '72ddf2c7-f400-4414-99b1-afb00b82c2d1', '1a376116-be60-49f4-a997-05f3aa2a4eb4'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:50 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:50:50 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:50 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.289s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:50:50 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Deleted volume successfully. Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af6cad9e-0795-468d-a0bd-df511b0b7461 tempest-VolumesExtendTest-1634297353 None] Lock "cinder-d9d28de4-ad4c-4208-8e12-4b962afb06d8-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:50 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a 1073741824" returned: 0 in 0.588s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:50 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a Sep 09 03:50:50 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:51 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a" returned: 0 in 0.285s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ce7aea-7174-47a1-bfde-d3bb49a9f514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4be002-c057-40f7-b574-273a6eef3d0a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57aadd5-b890-4b4c-a532-337ab0e8914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:51 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Volume volume-9d4be002-c057-40f7-b574-273a6eef3d0a (9d4be002-c057-40f7-b574-273a6eef3d0a): created successfully Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57aadd5-b890-4b4c-a532-337ab0e8914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (02c02c53-3c4b-4635-a7de-a27713a2eab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Flow 'volume_create_manager' (0b7cdf8e-16bc-4b96-8e11-d829050f44d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b6140f-f070-439b-bb49-3900c452e740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b6140f-f070-439b-bb49-3900c452e740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-458438126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7db8d66-efd2-42e4-898d-dc830b18d0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a728985ce734f249b3386ade1c5b8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:51Z,use_quota=True,user_id='2d996fce4c1547eeb7021b154422c191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c8411e-96c6-4ce3-9bc3-37e7b32d68d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c8411e-96c6-4ce3-9bc3-37e7b32d68d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4056d7cf-9326-4762-a4c0-9316cf333185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4056d7cf-9326-4762-a4c0-9316cf333185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7db8d66-efd2-42e4-898d-dc830b18d0d0', 'volume_name': 'volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be400125-ca38-45c2-bf51-48c5feb63e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be400125-ca38-45c2-bf51-48c5feb63e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5e9b3f-15ed-4ea1-b063-581e0c7ba2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:51 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Volume e7db8d66-efd2-42e4-898d-dc830b18d0d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0', 'volume_size': 1} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-458438126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7db8d66-efd2-42e4-898d-dc830b18d0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a728985ce734f249b3386ade1c5b8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:51Z,use_quota=True,user_id='2d996fce4c1547eeb7021b154422c191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Creating volume e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:50:51 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8f398427-ae21-4404-a3f8-8de163a97fea tempest-VolumesSnapshotTestJSON-879596971 None] Created volume successfully. Sep 09 03:50:51 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 1073741824 Sep 09 03:50:51 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:51 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 1073741824" returned: 0 in 0.425s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:51 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 Sep 09 03:50:51 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:52 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0" returned: 0 in 0.260s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5e9b3f-15ed-4ea1-b063-581e0c7ba2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cf2127-a9b6-4cd9-b4ad-a500934ed3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:52 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Volume volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 (e7db8d66-efd2-42e4-898d-dc830b18d0d0): created successfully Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cf2127-a9b6-4cd9-b4ad-a500934ed3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Flow 'volume_create_manager' (0b7cdf8e-16bc-4b96-8e11-d829050f44d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-10235292-507f-44ac-9b6a-a8d214a8f1c6 tempest-VolumesExtendTest-1634297353 None] Created volume successfully. Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Creating offline snapshot 26f032a2-c936-4bea-9861-117cb89041d3 of volume e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4d6311-2ce4-4afb-ae12-f187637da2a5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:52 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 Sep 09 03:50:52 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:52 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0" returned: 0 in 0.373s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:52 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 1G Sep 09 03:50:52 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:53 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 1G" returned: 0 in 0.419s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:53 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 Sep 09 03:50:53 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:53 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3" returned: 0 in 0.327s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:53 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 is being set with open permissions: ugo+rw Sep 09 03:50:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:53 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 Sep 09 03:50:53 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:53 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3" returned: 0 in 0.264s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:53 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.info Sep 09 03:50:53 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:54 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.info" returned: 0 in 0.262s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:54 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.info is being set with open permissions: ugo+rw Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:54 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.info Sep 09 03:50:54 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:54 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.info" returned: 0 in 0.319s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.025s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Creating offline snapshot fbcad8d4-61dc-40eb-a760-6c3f0317e71c of volume 9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Acquiring lock "cinder-b3d81308-1614-4f7c-9f03-9aefda3e3053-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a860356d-a845-44db-afdd-d6a823c80427 tempest-VolumesExtendTest-1634297353 None] Create snapshot completed successfully Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[01677ba9-e6e7-41a8-ada9-124fa72715bc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Lock "cinder-b3d81308-1614-4f7c-9f03-9aefda3e3053-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Acquiring lock "cinder-quobyte-b3d81308-1614-4f7c-9f03-9aefda3e3053" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Lock "cinder-quobyte-b3d81308-1614-4f7c-9f03-9aefda3e3053" acquired by "delete_volume" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16efa5c-dd96-4646-93d8-ed3ee12fad2f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:54 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a Sep 09 03:50:54 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:54 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 Sep 09 03:50:54 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:55 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a" returned: 0 in 0.393s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:55 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c 1G Sep 09 03:50:55 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:55 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053" returned: 0 in 0.402s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:55 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053 Sep 09 03:50:55 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:55 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b3d81308-1614-4f7c-9f03-9aefda3e3053" returned: 0 in 0.283s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Lock "cinder-quobyte-b3d81308-1614-4f7c-9f03-9aefda3e3053" released by "delete_volume" :: held 0.727s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:55 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c 1G" returned: 0 in 0.468s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4be002-c057-40f7-b574-273a6eef3d0a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:55 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4be002-c057-40f7-b574-273a6eef3d0a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c Sep 09 03:50:55 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Created reservations ['c4447038-4fa8-4624-a951-e97e79d7b4b4', '82f86bb5-bb2b-4ff5-8f01-21f7ad319cff', 'c792eb1b-d859-4469-870a-86e3664779f6', '1a55ef33-3a65-4bc3-8526-e8ae351a6d1c'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:55 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:50:55 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea3053be-4e18-4057-a06c-02ce41c315be tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:55 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4be002-c057-40f7-b574-273a6eef3d0a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c" returned: 0 in 0.409s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:55 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c is being set with open permissions: ugo+rw Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:55 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c Sep 09 03:50:55 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:55 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.340s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:50:55 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Deleted volume successfully. Sep 09 03:50:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-63a32367-a616-4102-97b2-27f513e19b26 tempest-VolumesNegativeTest-1955354095 None] Lock "cinder-b3d81308-1614-4f7c-9f03-9aefda3e3053-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:50:56 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c" returned: 0 in 0.272s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:56 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.info Sep 09 03:50:56 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:56 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.info" returned: 0 in 0.311s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:56 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.info is being set with open permissions: ugo+rw Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:56 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.info Sep 09 03:50:56 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:56 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.info" returned: 0 in 0.259s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea3053be-4e18-4057-a06c-02ce41c315be tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.004s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eb7dd8-e459-4389-9024-e1f22e72db67]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea3053be-4e18-4057-a06c-02ce41c315be tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-464a2902-40ce-4078-8aa9-d3d88e48c921 tempest-VolumesSnapshotTestJSON-879596971 None] Create snapshot completed successfully Sep 09 03:50:56 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 Sep 09 03:50:56 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:57 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea3053be-4e18-4057-a06c-02ce41c315be tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0" returned: 0 in 0.371s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea3053be-4e18-4057-a06c-02ce41c315be tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 2G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea3053be-4e18-4057-a06c-02ce41c315be tempest-VolumesExtendTest-1634297353 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 2G" returned: 0 in 0.143s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea3053be-4e18-4057-a06c-02ce41c315be tempest-VolumesExtendTest-1634297353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.551s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ea3053be-4e18-4057-a06c-02ce41c315be tempest-VolumesExtendTest-1634297353 None] Extend volume completed successfully. Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Acquiring lock "cinder-26f032a2-c936-4bea-9861-117cb89041d3-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Lock "cinder-26f032a2-c936-4bea-9861-117cb89041d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Acquiring lock "cinder-quobyte-e7db8d66-efd2-42e4-898d-dc830b18d0d0" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Lock "cinder-quobyte-e7db8d66-efd2-42e4-898d-dc830b18d0d0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Acquiring lock "cinder-quobyte-26f032a2-c936-4bea-9861-117cb89041d3" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Lock "cinder-quobyte-26f032a2-c936-4bea-9861-117cb89041d3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Deleting offline snapshot 26f032a2-c936-4bea-9861-117cb89041d3 of volume e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] snapshot_file for this snap is: volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdebef7e-2821-40c9-9dcf-378c5f2af25a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (67982f8a-92e1-4304-9216-cd23f5d27d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6313a5-3176-4a41-894d-f1b72754dd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6313a5-3176-4a41-894d-f1b72754dd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1511285175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cac75f-20fa-4c17-9698-c65344dcc064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41ca0f217747859366ee93bb6e661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:50:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fbcad8d4-61dc-40eb-a760-6c3f0317e71c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:50:58Z,use_quota=True,user_id='188900cdb7824245b5a073527ee54418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab27a52b-a92a-44b7-be19-4435948113d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:58 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 Sep 09 03:50:58 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab27a52b-a92a-44b7-be19-4435948113d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759e7db0-506e-4a16-9e30-543e8af9067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759e7db0-506e-4a16-9e30-543e8af9067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5cac75f-20fa-4c17-9698-c65344dcc064', 'volume_name': 'volume-b5cac75f-20fa-4c17-9698-c65344dcc064', 'volume_size': 2, 'snapshot_id': 'fbcad8d4-61dc-40eb-a760-6c3f0317e71c'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dea8326-73f6-457e-9d03-58e93b49f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dea8326-73f6-457e-9d03-58e93b49f49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4558391-8688-4d17-8c31-706692cc9665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:50:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Volume b5cac75f-20fa-4c17-9698-c65344dcc064: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5cac75f-20fa-4c17-9698-c65344dcc064', 'volume_size': 2, 'snapshot_id': 'fbcad8d4-61dc-40eb-a760-6c3f0317e71c'} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-fbcad8d4-61dc-40eb-a760-6c3f0317e71c-b5cac75f-20fa-4c17-9698-c65344dcc064" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-fbcad8d4-61dc-40eb-a760-6c3f0317e71c-b5cac75f-20fa-4c17-9698-c65344dcc064" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Creating volume b5cac75f-20fa-4c17-9698-c65344dcc064 from snapshot fbcad8d4-61dc-40eb-a760-6c3f0317e71c {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-b5cac75f-20fa-4c17-9698-c65344dcc064" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-b5cac75f-20fa-4c17-9698-c65344dcc064" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] snapshot: fbcad8d4-61dc-40eb-a760-6c3f0317e71c, volume: b5cac75f-20fa-4c17-9698-c65344dcc064, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b37b83d-2c80-4fe9-9755-abeb9a3cfc7d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:58 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c Sep 09 03:50:58 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:58 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3" returned: 0 in 0.424s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91fce95-6998-44ab-92e1-f51bc65fc812]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:58 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 Sep 09 03:50:58 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:58 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c" returned: 0 in 0.428s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d4be002-c057-40f7-b574-273a6eef3d0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0de9ea-27f5-4d7d-858d-1f42074f9d7c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:50:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:59 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a Sep 09 03:50:59 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:59 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0" returned: 0 in 0.440s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:59 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 Sep 09 03:50:59 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:59 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a" returned: 0 in 0.483s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:59 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 Sep 09 03:50:59 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:59 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3" returned: 0 in 0.526s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:50:59 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3 Sep 09 03:50:59 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:50:59 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 09 03:50:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0.26f032a2-c936-4bea-9861-117cb89041d3" returned: 0 in 0.293s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Lock "cinder-quobyte-26f032a2-c936-4bea-9861-117cb89041d3" released by "_delete_snapshot" :: held 1.822s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Lock "cinder-quobyte-e7db8d66-efd2-42e4-898d-dc830b18d0d0" released by "delete_snapshot" :: held 1.852s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:00 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Created reservations ['fc15efcc-30ab-4b33-b620-038e19b34933', '03b50a33-fd4c-4916-a24d-28d0cae3e593', '720fab81-fabd-47d7-9910-28b87366ab4a', '0b90cf4b-7035-408d-8e78-b3167d566d55'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:00 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Delete snapshot completed successfully. Sep 09 03:51:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e5b6ffb-2a14-4759-9b96-6f575d81e9ff tempest-VolumesExtendTest-1634297353 None] Lock "cinder-26f032a2-c936-4bea-9861-117cb89041d3-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Acquiring lock "cinder-e7db8d66-efd2-42e4-898d-dc830b18d0d0-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Lock "cinder-e7db8d66-efd2-42e4-898d-dc830b18d0d0-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Acquiring lock "cinder-quobyte-e7db8d66-efd2-42e4-898d-dc830b18d0d0" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Lock "cinder-quobyte-e7db8d66-efd2-42e4-898d-dc830b18d0d0" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:01 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69dde2-6caa-4fba-9bea-9fe96d98e436]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:01 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 Sep 09 03:51:01 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:01 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0" returned: 0 in 0.854s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:02 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0 Sep 09 03:51:02 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Flow 'volume_create_manager' (6af57ca5-6e6f-402b-8334-075210de3a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c60874-ce5e-44ef-b02c-6f92c5d11e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c60874-ce5e-44ef-b02c-6f92c5d11e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-828351541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63998c75-05e1-4152-85c1-b8a67201a110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b63c68a1b1460c8e747ca6080c2a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:02Z,use_quota=True,user_id='8170d2a5f35d4d51bb77fb1f055a5c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbdd88a-4a69-4376-a38c-1eb33dc3c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbdd88a-4a69-4376-a38c-1eb33dc3c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614c95eb-5116-416c-a7ca-27148ad7c7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614c95eb-5116-416c-a7ca-27148ad7c7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63998c75-05e1-4152-85c1-b8a67201a110', 'volume_name': 'volume-63998c75-05e1-4152-85c1-b8a67201a110', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38cb7b79-379c-45e4-a810-86041c39379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38cb7b79-379c-45e4-a810-86041c39379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f89d02b-ab1b-4259-b49a-c63a36685938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:02 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Volume 63998c75-05e1-4152-85c1-b8a67201a110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63998c75-05e1-4152-85c1-b8a67201a110', 'volume_size': 1} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:02 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e7db8d66-efd2-42e4-898d-dc830b18d0d0" returned: 0 in 0.673s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Lock "cinder-quobyte-e7db8d66-efd2-42e4-898d-dc830b18d0d0" released by "delete_volume" :: held 1.715s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:02 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Created reservations ['030d5dcc-5ba7-41dd-a144-37797292c79e', '3e2d7804-2b0a-47c7-93a2-90f03c470467', '4fde0562-590e-4b5f-9326-1a4f1773fd9a', '54d80a84-7a53-48b3-b974-f25faa31d331'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:03 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:03 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:03 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.744s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Deleted volume successfully. Sep 09 03:51:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c7a7d359-7ffe-447b-b816-7d76b304db9d tempest-VolumesExtendTest-1634297353 None] Lock "cinder-e7db8d66-efd2-42e4-898d-dc830b18d0d0-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:05 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064" returned: 0 in 6.058s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:51:05 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Converted 1024.00 MB image at 168.97 MB/s Sep 09 03:51:05 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 is being set with open permissions: ugo+rw Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:05 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 Sep 09 03:51:05 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:05 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-b5cac75f-20fa-4c17-9698-c65344dcc064" released by "_copy_volume_from_snapshot" :: held 7.363s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-fbcad8d4-61dc-40eb-a760-6c3f0317e71c-b5cac75f-20fa-4c17-9698-c65344dcc064" released by "_create_volume_from_snapshot" :: held 7.453s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.475s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.350s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-828351541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63998c75-05e1-4152-85c1-b8a67201a110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b63c68a1b1460c8e747ca6080c2a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:02Z,use_quota=True,user_id='8170d2a5f35d4d51bb77fb1f055a5c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Creating volume 63998c75-05e1-4152-85c1-b8a67201a110 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:05 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:05 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 1073741824 Sep 09 03:51:05 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4558391-8688-4d17-8c31-706692cc9665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5cac75f-20fa-4c17-9698-c65344dcc064', 'volume_size': 2, 'snapshot_id': 'fbcad8d4-61dc-40eb-a760-6c3f0317e71c'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1514f8e7-9c11-4d5c-982c-2274dc956714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:05 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Volume volume-b5cac75f-20fa-4c17-9698-c65344dcc064 (b5cac75f-20fa-4c17-9698-c65344dcc064): created successfully Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1514f8e7-9c11-4d5c-982c-2274dc956714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (67982f8a-92e1-4304-9216-cd23f5d27d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:06 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-08e0adee-79f0-477c-8c07-cb1d8ed5a60b tempest-VolumesSnapshotTestJSON-879596971 None] Created volume successfully. Sep 09 03:51:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-b5cac75f-20fa-4c17-9698-c65344dcc064-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-b5cac75f-20fa-4c17-9698-c65344dcc064-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-b5cac75f-20fa-4c17-9698-c65344dcc064" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:06 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 1073741824" returned: 0 in 0.668s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-b5cac75f-20fa-4c17-9698-c65344dcc064" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:06 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b23c1-0620-4f10-be2c-02bce248cc1e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:06 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 Sep 09 03:51:06 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:06 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 Sep 09 03:51:06 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:07 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110" returned: 0 in 0.482s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:07 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f89d02b-ab1b-4259-b49a-c63a36685938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63998c75-05e1-4152-85c1-b8a67201a110', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c8a205-3a37-408d-bd34-8811c14dfcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064" returned: 0 in 0.565s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:07 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064 Sep 09 03:51:07 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Volume volume-63998c75-05e1-4152-85c1-b8a67201a110 (63998c75-05e1-4152-85c1-b8a67201a110): created successfully Sep 09 03:51:07 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c8a205-3a37-408d-bd34-8811c14dfcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Flow 'volume_create_manager' (6af57ca5-6e6f-402b-8334-075210de3a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-41371c35-30bb-4a4f-88d8-0ab29659af18 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Created volume successfully. Sep 09 03:51:07 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b5cac75f-20fa-4c17-9698-c65344dcc064" returned: 0 in 0.317s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-b5cac75f-20fa-4c17-9698-c65344dcc064" released by "delete_volume" :: held 0.937s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Created reservations ['19713a8d-83bc-4db1-abfc-494945b7a45b', 'f8c92082-c50d-4cf0-a533-20f2ba3f70d5', '0dbfbf6d-8155-43e0-b558-77df7f157200', 'd15db350-d4c9-4488-98c6-d78fe51ad369'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:07 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:07 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:08 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.375s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:08 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Deleted volume successfully. Sep 09 03:51:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c67f034d-1b6f-44de-bbfa-32d050f991cb tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-b5cac75f-20fa-4c17-9698-c65344dcc064-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-58f0b13f-89a4-49fb-97b5-29cb6c848f4f req-105376d4-2df4-4cdc-a9e9-8fac8854ff2a tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-58f0b13f-89a4-49fb-97b5-29cb6c848f4f req-105376d4-2df4-4cdc-a9e9-8fac8854ff2a tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-58f0b13f-89a4-49fb-97b5-29cb6c848f4f req-105376d4-2df4-4cdc-a9e9-8fac8854ff2a tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-58f0b13f-89a4-49fb-97b5-29cb6c848f4f req-105376d4-2df4-4cdc-a9e9-8fac8854ff2a tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-63998c75-05e1-4152-85c1-b8a67201a110', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38e5d505-dfda-485a-beb9-ac488e402141', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:51:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-58f0b13f-89a4-49fb-97b5-29cb6c848f4f req-105376d4-2df4-4cdc-a9e9-8fac8854ff2a tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] attachment_update completed successfully. Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-fbcad8d4-61dc-40eb-a760-6c3f0317e71c-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-fbcad8d4-61dc-40eb-a760-6c3f0317e71c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-9d4be002-c057-40f7-b574-273a6eef3d0a" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-9d4be002-c057-40f7-b574-273a6eef3d0a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-fbcad8d4-61dc-40eb-a760-6c3f0317e71c" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-fbcad8d4-61dc-40eb-a760-6c3f0317e71c" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Deleting offline snapshot fbcad8d4-61dc-40eb-a760-6c3f0317e71c of volume 9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] snapshot_file for this snap is: volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9f07e9-c595-4481-8f94-b000a45ba714]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:09 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c Sep 09 03:51:09 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:09 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c" returned: 0 in 0.604s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d4be002-c057-40f7-b574-273a6eef3d0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (0b2259a3-9f42-4679-baab-3ab1198c6045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2951dccc-2cde-43f3-83fa-0723a0c3a07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0d506b-9944-4353-8acb-d5fb590fde0f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2951dccc-2cde-43f3-83fa-0723a0c3a07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-334772386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c10fc95-d269-4862-9618-2b4971c69c43,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:10Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541c01fe-13b0-42a3-92f2-c0e7f34eb3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541c01fe-13b0-42a3-92f2-c0e7f34eb3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4279e37-262a-4a62-b94f-b374f3915ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4279e37-262a-4a62-b94f-b374f3915ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c10fc95-d269-4862-9618-2b4971c69c43', 'volume_name': 'volume-6c10fc95-d269-4862-9618-2b4971c69c43', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7316301-eebd-4324-8dcf-d6c6fc0db50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7316301-eebd-4324-8dcf-d6c6fc0db50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a1a24d-5942-45bc-b203-841f5e7fab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:09 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Volume 6c10fc95-d269-4862-9618-2b4971c69c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c10fc95-d269-4862-9618-2b4971c69c43', 'volume_size': 1} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-334772386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c10fc95-d269-4862-9618-2b4971c69c43,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:10Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Creating volume 6c10fc95-d269-4862-9618-2b4971c69c43 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:09 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:10 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 1073741824 Sep 09 03:51:10 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:10 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a Sep 09 03:51:10 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:10 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 1073741824" returned: 0 in 0.567s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:10 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a" returned: 0 in 0.701s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:10 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c Sep 09 03:51:10 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:10 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 Sep 09 03:51:10 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:10 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43" returned: 0 in 0.284s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a1a24d-5942-45bc-b203-841f5e7fab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c10fc95-d269-4862-9618-2b4971c69c43', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd36d3f-d542-4c80-8fda-bf84286df136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Volume volume-6c10fc95-d269-4862-9618-2b4971c69c43 (6c10fc95-d269-4862-9618-2b4971c69c43): created successfully Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd36d3f-d542-4c80-8fda-bf84286df136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (0b2259a3-9f42-4679-baab-3ab1198c6045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ea633219-5ea6-4bd4-acac-cdeba0688086 tempest-VolumesGetTest-494417386 None] Created volume successfully. Sep 09 03:51:11 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c" returned: 0 in 0.504s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:11 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c Sep 09 03:51:11 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:11 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a.fbcad8d4-61dc-40eb-a760-6c3f0317e71c" returned: 0 in 0.335s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-fbcad8d4-61dc-40eb-a760-6c3f0317e71c" released by "_delete_snapshot" :: held 2.378s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-9d4be002-c057-40f7-b574-273a6eef3d0a" released by "delete_snapshot" :: held 2.435s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:11 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Created reservations ['235bc59e-da8c-4038-a8ed-d89d986ef789', '8c393182-a3c7-45a4-91a5-2e9bbe9d0d2a', '5824d29f-b16a-4ff8-95eb-8a45656647e0', 'e1849461-015c-42a6-80dd-c225546fc017'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:11 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Delete snapshot completed successfully. Sep 09 03:51:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-73b4e52b-bf89-4711-b171-80372e2a25fd tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-fbcad8d4-61dc-40eb-a760-6c3f0317e71c-delete_snapshot" released by "delete_snapshot" :: held 2.627s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-9d4be002-c057-40f7-b574-273a6eef3d0a-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-9d4be002-c057-40f7-b574-273a6eef3d0a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-9d4be002-c057-40f7-b574-273a6eef3d0a" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-9d4be002-c057-40f7-b574-273a6eef3d0a" acquired by "delete_volume" :: waited 0.058s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:12 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f36f2bd-4e2d-4379-b133-0e009c7d736c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-9f726b20-20a6-4770-9b9a-1448711a5e38 req-27164056-2917-4012-b93f-b33b405afc75 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Terminate volume connection completed successfully. Sep 09 03:51:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-9f726b20-20a6-4770-9b9a-1448711a5e38 req-27164056-2917-4012-b93f-b33b405afc75 tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Deleting attachment 38e5d505-dfda-485a-beb9-ac488e402141. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:51:12 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (9040dec5-d96d-4857-ac10-e8d02d4cb022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50ded5c-6324-465c-8706-b1ed404838cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:13 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a Sep 09 03:51:13 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50ded5c-6324-465c-8706-b1ed404838cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499138524',display_name='tempest-VolumesGetTest-Volume-577950375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802b7d5c-ec49-4ce2-a96c-7abe8eca71d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:13Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7783c251-5328-46e6-88f5-6d6e1e8a6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7783c251-5328-46e6-88f5-6d6e1e8a6d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afcd85d-1cb4-4509-b9da-28d1a3b2a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afcd85d-1cb4-4509-b9da-28d1a3b2a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802b7d5c-ec49-4ce2-a96c-7abe8eca71d6', 'volume_name': 'volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e612565d-2b6d-4b1b-825f-0b540a42de41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e612565d-2b6d-4b1b-825f-0b540a42de41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962d6f6a-5b09-40e7-b592-8d98ec6d5084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:13 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Volume 802b7d5c-ec49-4ce2-a96c-7abe8eca71d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6', 'volume_size': 1} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499138524',display_name='tempest-VolumesGetTest-Volume-577950375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802b7d5c-ec49-4ce2-a96c-7abe8eca71d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:13Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Creating volume 802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:13 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:13 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 1073741824 Sep 09 03:51:13 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:13 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a" returned: 0 in 0.561s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:13 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a Sep 09 03:51:13 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Acquiring lock "cinder-63998c75-05e1-4152-85c1-b8a67201a110-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "cinder-63998c75-05e1-4152-85c1-b8a67201a110-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Acquiring lock "cinder-quobyte-63998c75-05e1-4152-85c1-b8a67201a110" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "cinder-quobyte-63998c75-05e1-4152-85c1-b8a67201a110" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a474afa7-ba56-4c71-86ff-8cfe263b938c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:13 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 1073741824" returned: 0 in 0.819s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:13 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 Sep 09 03:51:13 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:13 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9d4be002-c057-40f7-b574-273a6eef3d0a" returned: 0 in 0.535s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-9d4be002-c057-40f7-b574-273a6eef3d0a" released by "delete_volume" :: held 1.214s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:14 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 Sep 09 03:51:14 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Created reservations ['9f1b4c40-3717-4844-8f5e-6f0e55b518b9', 'f5712654-3e99-4e9b-84e1-df6e50e23c63', '6b42541a-9c2d-4d95-9aa4-534739c669ee', '03ff71f5-4443-4bc2-b770-aaf29b5ec0f7'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:14 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:14 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:14 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110" returned: 0 in 0.504s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:14 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110 Sep 09 03:51:14 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:14 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6" returned: 0 in 0.360s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962d6f6a-5b09-40e7-b592-8d98ec6d5084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cc2c07-89d8-41ef-b905-961fe8808b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:14 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Volume volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 (802b7d5c-ec49-4ce2-a96c-7abe8eca71d6): created successfully Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cc2c07-89d8-41ef-b905-961fe8808b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (9040dec5-d96d-4857-ac10-e8d02d4cb022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6d9f5e1c-256a-46aa-bf9f-ed9c3a8d24f5 tempest-VolumesGetTest-494417386 None] Created volume successfully. Sep 09 03:51:14 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.304s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Deleted volume successfully. Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-488b1ac5-8a21-4131-94b5-dccc12f20cdc tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-9d4be002-c057-40f7-b574-273a6eef3d0a-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:14 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-63998c75-05e1-4152-85c1-b8a67201a110" returned: 0 in 0.292s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "cinder-quobyte-63998c75-05e1-4152-85c1-b8a67201a110" released by "delete_volume" :: held 0.842s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Created reservations ['e3a0b0fd-c7c3-4a81-84f8-60a91bdf0180', '7de07cd9-4a70-4339-8d72-ed643b9664ac', 'fc0d2e52-5bc7-4788-9b88-13c92e1a7c01', '476b70e1-ee79-4f71-bff0-17b16c0e0339'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:14 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:14 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:15 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.454s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Deleted volume successfully. Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d29717c3-b211-4a9f-b58b-46ecf2f46b3d tempest-TestServerVolumeAttachScenarioOldVersion-785249938 None] Lock "cinder-63998c75-05e1-4152-85c1-b8a67201a110-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Lock "cinder-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6" acquired by "delete_volume" :: waited 0.059s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[860fff7e-3ec7-4f06-abe5-2b378acc7dbc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:15 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 Sep 09 03:51:15 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (fa3838ab-a912-40fa-9756-674efa9e74ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1f373f-c321-49f2-bf09-afd866eb2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1f373f-c321-49f2-bf09-afd866eb2b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1597537156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a189c1-4563-4eab-ba3a-67fe9758b007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41ca0f217747859366ee93bb6e661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:16Z,use_quota=True,user_id='188900cdb7824245b5a073527ee54418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6333fe1f-8b84-4bed-a143-420806d234fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6333fe1f-8b84-4bed-a143-420806d234fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f718509-fd4e-4f22-8cd0-f4b861d0d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f718509-fd4e-4f22-8cd0-f4b861d0d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a189c1-4563-4eab-ba3a-67fe9758b007', 'volume_name': 'volume-58a189c1-4563-4eab-ba3a-67fe9758b007', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e4e1ae-34af-450f-8e7c-1d659c124802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e4e1ae-34af-450f-8e7c-1d659c124802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1b57aa-e235-47ea-8dae-f65d1d765909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:16 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Volume 58a189c1-4563-4eab-ba3a-67fe9758b007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a189c1-4563-4eab-ba3a-67fe9758b007', 'volume_size': 1} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1597537156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a189c1-4563-4eab-ba3a-67fe9758b007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41ca0f217747859366ee93bb6e661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:16Z,use_quota=True,user_id='188900cdb7824245b5a073527ee54418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Creating volume 58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:16 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:16 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 1073741824 Sep 09 03:51:16 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:16 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6" returned: 0 in 0.533s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:16 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6 Sep 09 03:51:16 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:16 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6" returned: 0 in 0.454s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6" released by "delete_volume" :: held 1.127s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:16 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 1073741824" returned: 0 in 0.687s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Created reservations ['9b2c7008-55c6-4dce-bcca-2c7849bcce62', 'f680b02f-eead-4789-b372-f872dfe24660', '4ec43abf-d248-4a65-95a9-fcd2b0e136ae', '844aa602-c58d-4f61-a6ba-1ccf08f91fea'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:16 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 Sep 09 03:51:16 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:16 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:16 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:17 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007" returned: 0 in 0.332s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1b57aa-e235-47ea-8dae-f65d1d765909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a189c1-4563-4eab-ba3a-67fe9758b007', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdb54bc-7811-4dd9-b5c2-c2ac3d6ba608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:17 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Volume volume-58a189c1-4563-4eab-ba3a-67fe9758b007 (58a189c1-4563-4eab-ba3a-67fe9758b007): created successfully Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdb54bc-7811-4dd9-b5c2-c2ac3d6ba608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (fa3838ab-a912-40fa-9756-674efa9e74ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4f123079-8310-4a6d-8d8c-7eb9da6f570c tempest-VolumesSnapshotTestJSON-879596971 None] Created volume successfully. Sep 09 03:51:17 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.414s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Deleted volume successfully. Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-894df30f-fce2-4a75-86c3-4a26f98dc3e9 tempest-VolumesGetTest-494417386 None] Lock "cinder-802b7d5c-ec49-4ce2-a96c-7abe8eca71d6-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-6c10fc95-d269-4862-9618-2b4971c69c43-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Lock "cinder-6c10fc95-d269-4862-9618-2b4971c69c43-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-6c10fc95-d269-4862-9618-2b4971c69c43" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-6c10fc95-d269-4862-9618-2b4971c69c43" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc4bd32-2339-4e07-8f10-8aae8b517c92]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Creating offline snapshot b99a739a-74fe-45fc-8569-535e1dad23b6 of volume 58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e41d51-03bf-4756-b1ea-1e84807bc617]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:18 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 Sep 09 03:51:18 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:18 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 Sep 09 03:51:18 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:18 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43" returned: 0 in 0.515s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:18 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43 Sep 09 03:51:18 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:18 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007" returned: 0 in 0.463s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:18 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 1G Sep 09 03:51:18 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:18 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-6c10fc95-d269-4862-9618-2b4971c69c43" returned: 0 in 0.273s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-6c10fc95-d269-4862-9618-2b4971c69c43" released by "delete_volume" :: held 0.853s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:18 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Created reservations ['3e2d38ae-fff9-49a8-b986-d4e7a60657a0', '6dd6df54-e3e7-4737-a078-a0e2fdacf633', '1ca7a94b-2606-44ac-946b-87a1f0e81ad8', '9e854a79-6e55-416a-ab33-f12a3961f3b7'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:19 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:19 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:19 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 1G" returned: 0 in 0.544s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a189c1-4563-4eab-ba3a-67fe9758b007 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:19 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a189c1-4563-4eab-ba3a-67fe9758b007 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 Sep 09 03:51:19 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:19 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.487s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Deleted volume successfully. Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ba83ffda-97db-4bde-8378-a95c0d1be650 tempest-VolumesGetTest-494417386 None] Lock "cinder-6c10fc95-d269-4862-9618-2b4971c69c43-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:19 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a189c1-4563-4eab-ba3a-67fe9758b007 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6" returned: 0 in 0.428s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:19 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 is being set with open permissions: ugo+rw Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:19 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 Sep 09 03:51:19 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:19 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6" returned: 0 in 0.315s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:20 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.info Sep 09 03:51:20 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (0bd3545d-589d-4f01-a382-6c6a804a2ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1172513-53f8-48b2-9629-d9364f829442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1172513-53f8-48b2-9629-d9364f829442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-952154227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f801b4c2-c2e0-4ded-917a-c4f715f84678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:20Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83abeec-c272-4c99-afb3-133159108759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83abeec-c272-4c99-afb3-133159108759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcd2803-7f87-46ad-8cd9-3bba592b21b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcd2803-7f87-46ad-8cd9-3bba592b21b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f801b4c2-c2e0-4ded-917a-c4f715f84678', 'volume_name': 'volume-f801b4c2-c2e0-4ded-917a-c4f715f84678', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4849d0da-7d71-4fa6-a16f-a24c7d4eca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4849d0da-7d71-4fa6-a16f-a24c7d4eca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a37830-d2c8-427c-9881-fffc6086f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:20 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Volume f801b4c2-c2e0-4ded-917a-c4f715f84678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f801b4c2-c2e0-4ded-917a-c4f715f84678', 'volume_size': 1} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:20 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.info" returned: 0 in 0.266s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:20 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.info is being set with open permissions: ugo+rw Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:20 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.info Sep 09 03:51:20 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:20 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.info" returned: 0 in 0.264s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-952154227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f801b4c2-c2e0-4ded-917a-c4f715f84678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:20Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Creating volume f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:20 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:20 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 1073741824 Sep 09 03:51:20 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:20 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8d104199-9309-488f-8689-24a485e70a1b tempest-VolumesSnapshotTestJSON-879596971 None] Create snapshot completed successfully Sep 09 03:51:21 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 1073741824" returned: 0 in 0.609s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:21 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 Sep 09 03:51:21 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:21 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678" returned: 0 in 0.336s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a37830-d2c8-427c-9881-fffc6086f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f801b4c2-c2e0-4ded-917a-c4f715f84678', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f482e8dc-7d5c-494d-b086-2709875d08c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:21 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Volume volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 (f801b4c2-c2e0-4ded-917a-c4f715f84678): created successfully Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f482e8dc-7d5c-494d-b086-2709875d08c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (0bd3545d-589d-4f01-a382-6c6a804a2ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:21 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0b9989a1-e9c4-4bd9-a0f8-98d5c16b9879 tempest-VolumesGetTest-494417386 None] Created volume successfully. Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (73b45768-70de-4bff-a929-9a3ae5a4cc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9100bfaf-5997-45a8-ae80-cf9232f1c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9100bfaf-5997-45a8-ae80-cf9232f1c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-149329580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb54e5e-e2cf-4c96-a73b-a6005876a9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41ca0f217747859366ee93bb6e661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b99a739a-74fe-45fc-8569-535e1dad23b6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:22Z,use_quota=True,user_id='188900cdb7824245b5a073527ee54418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d63c28a-e963-4457-8fea-f508b81a6aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d63c28a-e963-4457-8fea-f508b81a6aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8ff572-9a69-401d-bb0e-5fc75c9a79e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8ff572-9a69-401d-bb0e-5fc75c9a79e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2eb54e5e-e2cf-4c96-a73b-a6005876a9db', 'volume_name': 'volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db', 'volume_size': 1, 'snapshot_id': 'b99a739a-74fe-45fc-8569-535e1dad23b6'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f37ee4f-614f-438f-a3c4-fd43f1e06ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f37ee4f-614f-438f-a3c4-fd43f1e06ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae81dcc2-45c7-4083-a420-ef0f670b49d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:22 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Volume 2eb54e5e-e2cf-4c96-a73b-a6005876a9db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db', 'volume_size': 1, 'snapshot_id': 'b99a739a-74fe-45fc-8569-535e1dad23b6'} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-b99a739a-74fe-45fc-8569-535e1dad23b6-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-b99a739a-74fe-45fc-8569-535e1dad23b6-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Creating volume 2eb54e5e-e2cf-4c96-a73b-a6005876a9db from snapshot b99a739a-74fe-45fc-8569-535e1dad23b6 {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] snapshot: b99a739a-74fe-45fc-8569-535e1dad23b6, volume: 2eb54e5e-e2cf-4c96-a73b-a6005876a9db, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[63454e5c-75a0-42f1-bd93-cfe062b44951]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:22 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 Sep 09 03:51:22 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:22 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6" returned: 0 in 0.529s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a189c1-4563-4eab-ba3a-67fe9758b007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c868a9-439b-43a7-887b-50b233eae411]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:23 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 Sep 09 03:51:23 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (2d6a6648-1e6c-4d2a-838d-1fa2ef701e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61e67ff-9d0f-4bb7-9f57-ed92f9926b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61e67ff-9d0f-4bb7-9f57-ed92f9926b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2074010226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbae4d0-6e3e-4531-a7c3-71028ccd660f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f801b4c2-c2e0-4ded-917a-c4f715f84678,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:23Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76855985-ee49-4bc3-a15b-93c65eca812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76855985-ee49-4bc3-a15b-93c65eca812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26110f1-7d27-4c88-a195-58f9fd446c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26110f1-7d27-4c88-a195-58f9fd446c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8bbae4d0-6e3e-4531-a7c3-71028ccd660f', 'volume_name': 'volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f', 'volume_size': 1, 'source_volid': 'f801b4c2-c2e0-4ded-917a-c4f715f84678', 'source_volstatus': 'available'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f921163-e3f4-4ca9-9e59-02ac88e43412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f921163-e3f4-4ca9-9e59-02ac88e43412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c3a347-1096-413e-8bc5-e0af2a8daabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:23 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Volume 8bbae4d0-6e3e-4531-a7c3-71028ccd660f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f', 'volume_size': 1, 'source_volid': 'f801b4c2-c2e0-4ded-917a-c4f715f84678', 'source_volstatus': 'available'} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:23 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007" returned: 0 in 0.575s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:51:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:23 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db Sep 09 03:51:23 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:29 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" returned: 0 in 5.842s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:51:29 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Converted 1024.00 MB image at 175.25 MB/s Sep 09 03:51:29 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db is being set with open permissions: ugo+rw Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:29 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db Sep 09 03:51:29 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:29 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" returned: 0 in 0.265s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" released by "_copy_volume_from_snapshot" :: held 7.348s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-b99a739a-74fe-45fc-8569-535e1dad23b6-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" released by "_create_volume_from_snapshot" :: held 7.441s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.464s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.450s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:29 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Cloning volume f801b4c2-c2e0-4ded-917a-c4f715f84678 to volume 8bbae4d0-6e3e-4531-a7c3-71028ccd660f Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae81dcc2-45c7-4083-a420-ef0f670b49d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db', 'volume_size': 1, 'snapshot_id': 'b99a739a-74fe-45fc-8569-535e1dad23b6'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596e0d9e-2c18-4e3f-ab4f-9292218c0abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:29 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Volume volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db (2eb54e5e-e2cf-4c96-a73b-a6005876a9db): created successfully Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596e0d9e-2c18-4e3f-ab4f-9292218c0abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Flow 'volume_create_manager' (73b45768-70de-4bff-a929-9a3ae5a4cc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Creating offline snapshot 4cfefcb2-d9a0-4b14-ba7e-02d33402414d of volume f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a000736-5de7-4350-8a95-12206bad3154]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:29 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fc6029e0-42b2-4f86-833e-76ef8866db36 tempest-VolumesSnapshotTestJSON-879596971 None] Created volume successfully. Sep 09 03:51:29 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 Sep 09 03:51:29 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-2eb54e5e-e2cf-4c96-a73b-a6005876a9db-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-2eb54e5e-e2cf-4c96-a73b-a6005876a9db-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbb257e-6b1b-4b54-9560-8f273698adb5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:30 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:30 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db Sep 09 03:51:30 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678" returned: 0 in 0.494s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:30 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d 1G Sep 09 03:51:30 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:30 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" returned: 0 in 0.497s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:30 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db Sep 09 03:51:30 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:31 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d 1G" returned: 0 in 0.685s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:31 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d Sep 09 03:51:31 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:31 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" returned: 0 in 0.390s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-2eb54e5e-e2cf-4c96-a73b-a6005876a9db" released by "delete_volume" :: held 0.948s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Created reservations ['cd8c8eb1-06f6-4175-a59f-c66670eff852', '83a8da37-d103-43dc-b986-bf98a0c08889', 'b0c6cb68-78a6-4a43-b2d4-3deae7d9397d', '3aa21fe6-1efc-4eae-8957-cd41da271918'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:31 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:31 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:31 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d" returned: 0 in 0.390s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:31 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d is being set with open permissions: ugo+rw Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:31 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d Sep 09 03:51:31 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:31 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.290s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Deleted volume successfully. Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6672eadb-9c39-47c6-af1a-6cdacce52097 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-2eb54e5e-e2cf-4c96-a73b-a6005876a9db-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:31 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d" returned: 0 in 0.295s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:31 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.info Sep 09 03:51:31 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:32 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.info" returned: 0 in 0.312s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:32 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.info is being set with open permissions: ugo+rw Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:32 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.info Sep 09 03:51:32 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Flow 'volume_create_manager' (6145e4b3-4653-4c82-9be8-180d4239a559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68bef2b4-af1f-4e95-a791-bd7589b997c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68bef2b4-af1f-4e95-a791-bd7589b997c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1420809147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5da6f22-e5b9-4d63-8957-d3020bf1388f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3936c6cfecc54be28cadd816a950502f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:32Z,use_quota=True,user_id='fd6eaace6141488d996873ff6f3f15a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27604dfb-08c3-430d-b9b3-e07abecc53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27604dfb-08c3-430d-b9b3-e07abecc53ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:32 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a70b94-9dab-4a2c-815e-cca437e38e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a70b94-9dab-4a2c-815e-cca437e38e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5da6f22-e5b9-4d63-8957-d3020bf1388f', 'volume_name': 'volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387d903b-3349-48e9-9f25-4d74c7c4fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387d903b-3349-48e9-9f25-4d74c7c4fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f5a3bc-a026-4df8-ba7a-df2fb494a700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Volume e5da6f22-e5b9-4d63-8957-d3020bf1388f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f', 'volume_size': 1} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.info" returned: 0 in 0.408s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-b99a739a-74fe-45fc-8569-535e1dad23b6-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] snapshot: 4cfefcb2-d9a0-4b14-ba7e-02d33402414d, volume: 8bbae4d0-6e3e-4531-a7c3-71028ccd660f, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-b99a739a-74fe-45fc-8569-535e1dad23b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-58a189c1-4563-4eab-ba3a-67fe9758b007" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-58a189c1-4563-4eab-ba3a-67fe9758b007" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-b99a739a-74fe-45fc-8569-535e1dad23b6" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea26ae7-31ed-4d29-b737-c65762cf5b58]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-b99a739a-74fe-45fc-8569-535e1dad23b6" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Deleting offline snapshot b99a739a-74fe-45fc-8569-535e1dad23b6 of volume 58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] snapshot_file for this snap is: volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e283aac9-69f3-4854-b973-83f51d8513ea]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:32 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d Sep 09 03:51:32 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:32 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 Sep 09 03:51:32 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:32 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Flow 'volume_create_manager' (e0aa85e4-6aed-4f29-a409-3f538e80846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1754f7bf-337c-4e49-a7dd-9f386e2b7a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1754f7bf-337c-4e49-a7dd-9f386e2b7a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1906338968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dd69e0-4934-4cb3-91ab-9f5861ea2f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3936c6cfecc54be28cadd816a950502f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:33Z,use_quota=True,user_id='fd6eaace6141488d996873ff6f3f15a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c04f88-6f43-4b1e-901f-051254605e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c04f88-6f43-4b1e-901f-051254605e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7232c88d-afda-4070-869e-ba249ac417c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7232c88d-afda-4070-869e-ba249ac417c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28dd69e0-4934-4cb3-91ab-9f5861ea2f46', 'volume_name': 'volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcce967f-8340-4703-a7a0-76cacbb26d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcce967f-8340-4703-a7a0-76cacbb26d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032481eb-cd59-4c52-8f19-ed8f822807d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:33 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Volume 28dd69e0-4934-4cb3-91ab-9f5861ea2f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46', 'volume_size': 1} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:33 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d" returned: 0 in 0.616s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f801b4c2-c2e0-4ded-917a-c4f715f84678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8abd3-aa8e-427d-b920-28fc958afa53]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:33 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6" returned: 0 in 0.723s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a189c1-4563-4eab-ba3a-67fe9758b007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:51:33 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 Sep 09 03:51:33 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca85cdd-1fbd-4dc4-b340-941912d67454]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:33 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 Sep 09 03:51:33 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:33 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678" returned: 0 in 0.565s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:51:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:33 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f Sep 09 03:51:33 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:34 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007" returned: 0 in 0.745s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:34 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 Sep 09 03:51:34 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:34 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6" returned: 0 in 0.767s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:35 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6 Sep 09 03:51:35 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:36 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007.b99a739a-74fe-45fc-8569-535e1dad23b6" returned: 0 in 1.200s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:36 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=130,cinder:UPDATE=131,cinder:INSERT=43,cinder:DELETE=12 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:51:36 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=134,cinder:UPDATE=146,cinder:DELETE=12,cinder:INSERT=35 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:51:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-b99a739a-74fe-45fc-8569-535e1dad23b6" released by "_delete_snapshot" :: held 3.666s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-58a189c1-4563-4eab-ba3a-67fe9758b007" released by "delete_snapshot" :: held 3.735s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:36 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Created reservations ['06cce453-cd8e-49df-a0b3-6ea6ce7cce98', 'bf104eed-93e1-4597-94f9-eba6991c0a91', 'feed5b1d-afab-4cb6-af89-054a7c131b2d', 'dbc50106-2311-4563-a061-6bf3103466ce'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:36 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Delete snapshot completed successfully. Sep 09 03:51:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2b5f6217-fc95-46dc-aa62-d5a83b29ea68 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-b99a739a-74fe-45fc-8569-535e1dad23b6-delete_snapshot" released by "delete_snapshot" :: held 4.060s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-58a189c1-4563-4eab-ba3a-67fe9758b007-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:37 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:37 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-58a189c1-4563-4eab-ba3a-67fe9758b007-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-58a189c1-4563-4eab-ba3a-67fe9758b007" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-58a189c1-4563-4eab-ba3a-67fe9758b007" acquired by "delete_volume" :: waited 0.050s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e1f22b-3178-4994-b92c-fbe00df4b152]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:38 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 Sep 09 03:51:38 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:38 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.885s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:38 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:38 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:51:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:51:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:51:38 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007" returned: 0 in 1.182s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:39 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007 Sep 09 03:51:39 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:39 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-58a189c1-4563-4eab-ba3a-67fe9758b007" returned: 0 in 0.975s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-58a189c1-4563-4eab-ba3a-67fe9758b007" released by "delete_volume" :: held 2.381s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Created reservations ['2989f8db-6902-4bdd-87f3-36cfb1710156', 'a9557647-120b-4a9a-8808-6b2dfae8ca54', '77ef5f5a-a275-4ee9-bd77-47d12dd25177', '2b708f4d-22df-4de9-8474-e8f4b200a982'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:40 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" returned: 0 in 6.530s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:51:40 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Converted 1024.00 MB image at 156.80 MB/s Sep 09 03:51:40 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f is being set with open permissions: ugo+rw Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:40 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f Sep 09 03:51:40 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:40 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:40 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:40 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" returned: 0 in 0.463s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" released by "_copy_volume_from_snapshot" :: held 8.307s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-4cfefcb2-d9a0-4b14-ba7e-02d33402414d" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-4cfefcb2-d9a0-4b14-ba7e-02d33402414d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:40 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Deleting offline snapshot 4cfefcb2-d9a0-4b14-ba7e-02d33402414d of volume f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] snapshot_file for this snap is: volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.510s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:40 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Deleted volume successfully. Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a6512e-cbf0-47b1-9cdd-5137a4251c51]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-daa0b3f4-777a-434c-bc92-c6864d9d2754 tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-58a189c1-4563-4eab-ba3a-67fe9758b007-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:41 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d Sep 09 03:51:41 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "cinder-quobyte-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" acquired by "delete_volume" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b470f21-f566-4bf3-8de3-30bcda8a009f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:41 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac Sep 09 03:51:41 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:41 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d" returned: 0 in 0.667s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f801b4c2-c2e0-4ded-917a-c4f715f84678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae470bad-5b66-474e-a60b-246e5f3e454e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:41 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 Sep 09 03:51:41 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:41 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" returned: 0 in 0.553s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:42 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac Sep 09 03:51:42 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:42 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" returned: 0 in 0.413s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-quobyte-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac" released by "delete_volume" :: held 1.118s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Created reservations ['298e6dd0-4802-485d-a7fc-a4863168b360', '41bdf22a-3b89-42e0-a47b-7fae9ba01e9d', '2c6cf0f9-406d-4070-8875-87c380d58812', '4e5bb15e-d9b2-400d-8a2c-3ae32394c7b4'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:42 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678" returned: 0 in 0.891s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:42 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:42 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:42 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:42 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:43 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.406s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Deleted volume successfully. Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-93d613b6-6522-4520-8dd3-a13382e3daba tempest-VolumesSnapshotTestJSON-879596971 None] Lock "cinder-8bf5cbf2-7b6b-4d77-8e59-abd29d66afac-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:43 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d" returned: 0 in 0.572s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:43 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d Sep 09 03:51:43 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:43 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678.4cfefcb2-d9a0-4b14-ba7e-02d33402414d" returned: 0 in 0.324s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-4cfefcb2-d9a0-4b14-ba7e-02d33402414d" released by "_delete_snapshot" :: held 2.609s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.882s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.122s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1420809147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5da6f22-e5b9-4d63-8957-d3020bf1388f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3936c6cfecc54be28cadd816a950502f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:32Z,use_quota=True,user_id='fd6eaace6141488d996873ff6f3f15a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Creating volume e5da6f22-e5b9-4d63-8957-d3020bf1388f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:43 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c3a347-1096-413e-8bc5-e0af2a8daabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f', 'volume_size': 1, 'source_volid': 'f801b4c2-c2e0-4ded-917a-c4f715f84678', 'source_volstatus': 'available'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:43 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f 1073741824 Sep 09 03:51:43 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619503c2-b99a-47f9-bcca-0efc1e24ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:43 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Volume volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f (8bbae4d0-6e3e-4531-a7c3-71028ccd660f): created successfully Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619503c2-b99a-47f9-bcca-0efc1e24ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (2d6a6648-1e6c-4d2a-838d-1fa2ef701e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-315ccb72-57e3-4d40-a4e7-13938d5b1a83 tempest-VolumesGetTest-494417386 None] Created volume successfully. Sep 09 03:51:44 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f 1073741824" returned: 0 in 0.554s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:44 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f Sep 09 03:51:44 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:44 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f" returned: 0 in 0.379s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.483s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1906338968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dd69e0-4934-4cb3-91ab-9f5861ea2f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3936c6cfecc54be28cadd816a950502f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:33Z,use_quota=True,user_id='fd6eaace6141488d996873ff6f3f15a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Creating volume 28dd69e0-4934-4cb3-91ab-9f5861ea2f46 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:44 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:44 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 1073741824 Sep 09 03:51:44 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f5a3bc-a026-4df8-ba7a-df2fb494a700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f17dfe-9c0a-431d-9715-faf14b528c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:44 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Volume volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f (e5da6f22-e5b9-4d63-8957-d3020bf1388f): created successfully Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f17dfe-9c0a-431d-9715-faf14b528c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Flow 'volume_create_manager' (6145e4b3-4653-4c82-9be8-180d4239a559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:44 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0acd30aa-059c-460f-8561-40f76360f66b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Created volume successfully. Sep 09 03:51:45 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 1073741824" returned: 0 in 0.644s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:45 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 Sep 09 03:51:45 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (e554a58d-f4af-4b2d-a8b0-01b37bfd2748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcb2cda-b7cf-4b32-bd87-730e7cfdb4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcb2cda-b7cf-4b32-bd87-730e7cfdb4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-430192402',display_name='tempest-VolumesGetTest-Volume-335639209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaa79e9-5ba6-4a27-adc5-21df4a1f946b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:46Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:45 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b386f1ea-af2f-4ed0-ac6b-65c50a0c6e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b386f1ea-af2f-4ed0-ac6b-65c50a0c6e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ada766f-764c-4f04-bb09-6fce4b478e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ada766f-764c-4f04-bb09-6fce4b478e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faaa79e9-5ba6-4a27-adc5-21df4a1f946b', 'volume_name': 'volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c802e7b0-07ed-4701-9084-80fd7939ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c802e7b0-07ed-4701-9084-80fd7939ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86b4723-51c9-44b9-a588-cc1097526618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:45 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Volume faaa79e9-5ba6-4a27-adc5-21df4a1f946b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b', 'volume_size': 1} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46" returned: 0 in 0.475s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-430192402',display_name='tempest-VolumesGetTest-Volume-335639209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaa79e9-5ba6-4a27-adc5-21df4a1f946b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:46Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Creating volume faaa79e9-5ba6-4a27-adc5-21df4a1f946b {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:45 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:45 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b 1073741824 Sep 09 03:51:45 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032481eb-cd59-4c52-8f19-ed8f822807d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ad3cf8-1f56-42db-89be-d9d004f308ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:45 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Volume volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 (28dd69e0-4934-4cb3-91ab-9f5861ea2f46): created successfully Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ad3cf8-1f56-42db-89be-d9d004f308ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Flow 'volume_create_manager' (e0aa85e4-6aed-4f29-a409-3f538e80846b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5479692a-eae9-4494-95c7-7e6f3413097b tempest-TestServerVolumeAttachmentScenario-1089655177 None] Created volume successfully. Sep 09 03:51:46 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b 1073741824" returned: 0 in 0.796s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:46 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b Sep 09 03:51:46 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:47 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b" returned: 0 in 0.447s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:51:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86b4723-51c9-44b9-a588-cc1097526618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0014ce-a601-44e3-9556-435c4496d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Volume volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b (faaa79e9-5ba6-4a27-adc5-21df4a1f946b): created successfully Sep 09 03:51:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0014ce-a601-44e3-9556-435c4496d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (e554a58d-f4af-4b2d-a8b0-01b37bfd2748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:47 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-edb6f13f-96a1-444f-9102-401d5d749f73 tempest-VolumesGetTest-494417386 None] Created volume successfully. Sep 09 03:51:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-faaa79e9-5ba6-4a27-adc5-21df4a1f946b-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Lock "cinder-faaa79e9-5ba6-4a27-adc5-21df4a1f946b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-faaa79e9-5ba6-4a27-adc5-21df4a1f946b" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-faaa79e9-5ba6-4a27-adc5-21df4a1f946b" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:48 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e049bdc8-ee6a-4af0-aa8d-ad51cb8dc5a9]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:48 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b Sep 09 03:51:48 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:48 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b" returned: 0 in 0.555s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:48 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b Sep 09 03:51:49 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:49 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-faaa79e9-5ba6-4a27-adc5-21df4a1f946b" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-faaa79e9-5ba6-4a27-adc5-21df4a1f946b" released by "delete_volume" :: held 0.943s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Created reservations ['62d51824-044a-4535-b2be-2c012d446903', 'cd98ea73-e788-4050-b3c1-d7d56c247358', '9145b607-a28c-42ca-ba98-da418a5ba5c2', '4d0391ae-b6a1-4648-9614-1f016fe27223'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:49 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:49 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:49 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.282s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Deleted volume successfully. Sep 09 03:51:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bd382df8-fda3-4358-9c90-b08d04516473 tempest-VolumesGetTest-494417386 None] Lock "cinder-faaa79e9-5ba6-4a27-adc5-21df4a1f946b-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-8bbae4d0-6e3e-4531-a7c3-71028ccd660f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Lock "cinder-8bbae4d0-6e3e-4531-a7c3-71028ccd660f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:50 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0407b8-e0ab-46b9-994a-b2f17d82db31]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:51 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f Sep 09 03:51:51 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:51 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" returned: 0 in 0.508s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:51 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f Sep 09 03:51:51 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:51 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" returned: 0 in 0.348s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-8bbae4d0-6e3e-4531-a7c3-71028ccd660f" released by "delete_volume" :: held 0.929s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Created reservations ['823f333e-1cd7-4394-a619-ab3f035e9666', '5b8ba8d6-bad0-4168-9baa-684db6b6f98b', '1d256086-4ce7-442f-94ac-7d724b7c8ef7', '2fc4bc5f-9e30-4ca1-8056-5dc5d9dcbdb7'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:51 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:51 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:52 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.411s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:52 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Deleted volume successfully. Sep 09 03:51:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f5eeec8c-49e7-48de-b6ac-f94260a3c7c0 tempest-VolumesGetTest-494417386 None] Lock "cinder-8bbae4d0-6e3e-4531-a7c3-71028ccd660f-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-f801b4c2-c2e0-4ded-917a-c4f715f84678-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Lock "cinder-f801b4c2-c2e0-4ded-917a-c4f715f84678-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-f801b4c2-c2e0-4ded-917a-c4f715f84678" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:51:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-f801b4c2-c2e0-4ded-917a-c4f715f84678" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:51:53 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e42501b-e2f6-428c-81db-cc32498b64a6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:53 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 Sep 09 03:51:53 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:53 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678" returned: 0 in 0.512s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:53 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678 Sep 09 03:51:53 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:54 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f801b4c2-c2e0-4ded-917a-c4f715f84678" returned: 0 in 0.498s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-f801b4c2-c2e0-4ded-917a-c4f715f84678" released by "delete_volume" :: held 1.134s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Created reservations ['b69bc7b1-870a-437f-bcc6-fff53e7d1dd0', 'c30c8a5b-3867-449d-9c0e-701f9120789e', 'dc4825c0-340a-40ba-a673-aa575b1625f3', 'bdb73fac-4cb0-4cc6-9070-e9509c467fe5'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:54 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:51:54 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:54 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.392s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:54 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:51:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Deleted volume successfully. Sep 09 03:51:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c2791b56-8e9c-4e78-8f4c-789bbfbfc3d0 tempest-VolumesGetTest-494417386 None] Lock "cinder-f801b4c2-c2e0-4ded-917a-c4f715f84678-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:51:56 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (bb6fdbb7-c238-419b-95e7-28c9571d8eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3018611-5d69-4aa9-adb9-f543cf7e0e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3018611-5d69-4aa9-adb9-f543cf7e0e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-874900852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30caca7b-f894-4c2d-951d-7e285565fefc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:57Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa59f509-e11f-4a3d-af71-b4db706a7a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa59f509-e11f-4a3d-af71-b4db706a7a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:56 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d63692d-f083-4cfa-a76a-a27f3b3f6074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:56 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:51:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d63692d-f083-4cfa-a76a-a27f3b3f6074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30caca7b-f894-4c2d-951d-7e285565fefc', 'volume_name': 'volume-30caca7b-f894-4c2d-951d-7e285565fefc', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f670ddf4-71b6-49ef-83be-2fe3f7b50300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f670ddf4-71b6-49ef-83be-2fe3f7b50300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc411ae4-5013-43e5-9101-dc80ea1123db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:57 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Volume 30caca7b-f894-4c2d-951d-7e285565fefc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30caca7b-f894-4c2d-951d-7e285565fefc', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 03:51:57 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Trying to clone 30caca7b-f894-4c2d-951d-7e285565fefc from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f at location (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:51:57 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:51:57 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Image download 20.69 MB at 20.69 MB/s Sep 09 03:51:57 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e027a9cf-4ef8-45d4-badc-2d5d209a41c4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:58 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD Sep 09 03:51:58 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:58 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:58 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f is fetched for user bec60d0a510a47278a391a0c06a74244. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:51:58 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f5d6b8-d0e7-4eaf-9bee-0f1960bc9580]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:51:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:58 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD Sep 09 03:51:58 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Flow 'volume_create_manager' (abb97873-6f9b-4ff6-adbe-9027bf108e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd20b03e-6baa-444e-8b97-a505aeea7a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:59 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-874900852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30caca7b-f894-4c2d-951d-7e285565fefc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:57Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Creating volume 30caca7b-f894-4c2d-951d-7e285565fefc {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:51:59 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd20b03e-6baa-444e-8b97-a505aeea7a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1900831996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0060f1b-70a8-419d-9ae0-593dd4f19a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c884ff9bca384023bec8492a4aa7a8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:59Z,use_quota=True,user_id='23ef63e5505a48da887b314c83a5dbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fb5481-c2b8-4665-8b7f-e916d5d3f53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:59 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc 1073741824 Sep 09 03:51:59 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fb5481-c2b8-4665-8b7f-e916d5d3f53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2a20aa-c2c3-4e6d-9e7c-725628bff0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2a20aa-c2c3-4e6d-9e7c-725628bff0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0060f1b-70a8-419d-9ae0-593dd4f19a7e', 'volume_name': 'volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e', 'volume_size': 2}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6de2cf-fac5-4bb1-9931-74e751ff30f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6de2cf-fac5-4bb1-9931-74e751ff30f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104ae86f-2d5f-4ef3-aee6-078083dbfc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:51:59 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Volume b0060f1b-70a8-419d-9ae0-593dd4f19a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e', 'volume_size': 2} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:51:59 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc 1073741824" returned: 0 in 0.544s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:51:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:51:59 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc Sep 09 03:51:59 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:00 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc" returned: 0 in 0.324s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1900831996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0060f1b-70a8-419d-9ae0-593dd4f19a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c884ff9bca384023bec8492a4aa7a8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:51:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:51:59Z,use_quota=True,user_id='23ef63e5505a48da887b314c83a5dbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Creating volume b0060f1b-70a8-419d-9ae0-593dd4f19a7e {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:52:00 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e 2147483648 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:00 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e 2147483648 Sep 09 03:52:00 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Attempting download of 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume 30caca7b-f894-4c2d-951d-7e285565fefc. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d34487-5e0d-446c-987f-e74d43ec06e5]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_dyk6pj4i {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:00 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_dyk6pj4i Sep 09 03:52:00 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:00 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_dyk6pj4i" returned: 0 in 0.435s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_dyk6pj4i {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:00 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_dyk6pj4i Sep 09 03:52:00 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:00 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e 2147483648" returned: 0 in 0.710s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:00 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e Sep 09 03:52:00 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:01 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_dyk6pj4i" returned: 1 in 0.508s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_dyk6pj4i' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b37473c-b83f-49b1-b003-4df0b6f53013]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:01 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" returned: 0 in 0.346s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104ae86f-2d5f-4ef3-aee6-078083dbfc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e', 'volume_size': 2}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de6517a-621d-4f40-8080-7b1e18fb324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:01 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Volume volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e (b0060f1b-70a8-419d-9ae0-593dd4f19a7e): created successfully Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de6517a-621d-4f40-8080-7b1e18fb324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Flow 'volume_create_manager' (abb97873-6f9b-4ff6-adbe-9027bf108e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:01 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0a34ddc7-66f3-4ca4-b8b5-a9e39f48850a tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Created volume successfully. Sep 09 03:52:01 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD Sep 09 03:52:01 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:01 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f was qcow2, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:52:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:01 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc Sep 09 03:52:01 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Creating offline snapshot 24bebadd-d406-46e4-8995-562fd7a05825 of volume b0060f1b-70a8-419d-9ae0-593dd4f19a7e {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:52:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9092f1b-e805-4d8f-89ef-07f3bee65e5b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:02 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e Sep 09 03:52:02 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:02 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" returned: 0 in 0.502s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 2G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:03 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 2G Sep 09 03:52:03 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:03 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 2G" returned: 0 in 0.544s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:03 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 Sep 09 03:52:03 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:03 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc" returned: 0 in 2.111s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_rjo3tcnkdevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:52:03 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Converted 112.00 MB image at 53.02 MB/s Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:03 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc 1G Sep 09 03:52:03 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:03 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825" returned: 0 in 0.335s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:03 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 is being set with open permissions: ugo+rw Sep 09 03:52:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:03 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 Sep 09 03:52:03 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:04 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc 1G" returned: 0 in 0.365s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Downloaded image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume 30caca7b-f894-4c2d-951d-7e285565fefc successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f for user bec60d0a510a47278a391a0c06a74244 is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Marking volume 30caca7b-f894-4c2d-951d-7e285565fefc as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Copying metadata from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f to 30caca7b-f894-4c2d-951d-7e285565fefc. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Creating volume glance metadata for volume 30caca7b-f894-4c2d-951d-7e285565fefc backed by image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc411ae4-5013-43e5-9101-dc80ea1123db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30caca7b-f894-4c2d-951d-7e285565fefc', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428482c7-ba09-4980-a9b6-d5c4a0d186fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:04 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Volume volume-30caca7b-f894-4c2d-951d-7e285565fefc (30caca7b-f894-4c2d-951d-7e285565fefc): created successfully Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428482c7-ba09-4980-a9b6-d5c4a0d186fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (bb6fdbb7-c238-419b-95e7-28c9571d8eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:04 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825" returned: 0 in 0.307s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-30f7aa6b-412e-4b4b-8016-d5e8c5a9b29d tempest-VolumesGetTest-494417386 None] Created volume successfully. Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:04 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.info Sep 09 03:52:04 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:04 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.info" returned: 0 in 0.299s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:04 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.info is being set with open permissions: ugo+rw Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:04 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.info Sep 09 03:52:04 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:04 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.info" returned: 0 in 0.287s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4b708a25-604a-4d4d-948f-0920bbd0de8e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Create snapshot completed successfully Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (70e7979c-51c8-43ae-84ed-b5667ba6ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0badb7-552d-43ef-a7b3-ae17e6c9ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0badb7-552d-43ef-a7b3-ae17e6c9ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:52:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1684243881',display_name='tempest-VolumesGetTest-Volume-1902429249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bcc082-285f-4be6-9135-042c8091381b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:05Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4fbe0a4-4a42-442e-9fe8-1d6942dcdf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4fbe0a4-4a42-442e-9fe8-1d6942dcdf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f0660b-6c49-47ca-bd50-e25482d2e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f0660b-6c49-47ca-bd50-e25482d2e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bcc082-285f-4be6-9135-042c8091381b', 'volume_name': 'volume-e2bcc082-285f-4be6-9135-042c8091381b', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba054d8-4853-4fc7-9ea5-6634dd51ca86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba054d8-4853-4fc7-9ea5-6634dd51ca86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454561be-d413-4fcc-b353-14232c3890b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:05 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Volume e2bcc082-285f-4be6-9135-042c8091381b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bcc082-285f-4be6-9135-042c8091381b', 'volume_size': 1} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:52:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1684243881',display_name='tempest-VolumesGetTest-Volume-1902429249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bcc082-285f-4be6-9135-042c8091381b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e44324c7174446b518a2bdb4136b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:05Z,use_quota=True,user_id='bec60d0a510a47278a391a0c06a74244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Creating volume e2bcc082-285f-4be6-9135-042c8091381b {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:52:05 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:05 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b 1073741824 Sep 09 03:52:05 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:05 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b 1073741824" returned: 0 in 0.473s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:05 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b Sep 09 03:52:05 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "cinder-24bebadd-d406-46e4-8995-562fd7a05825-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-24bebadd-d406-46e4-8995-562fd7a05825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "cinder-quobyte-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-quobyte-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "cinder-quobyte-24bebadd-d406-46e4-8995-562fd7a05825" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-quobyte-24bebadd-d406-46e4-8995-562fd7a05825" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Deleting offline snapshot 24bebadd-d406-46e4-8995-562fd7a05825 of volume b0060f1b-70a8-419d-9ae0-593dd4f19a7e {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] snapshot_file for this snap is: volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc7f89-f81f-40d4-b2a0-79ef44af2e16]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:06 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b" returned: 0 in 0.329s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:06 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 Sep 09 03:52:06 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454561be-d413-4fcc-b353-14232c3890b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bcc082-285f-4be6-9135-042c8091381b', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8791745b-beb7-4d40-809c-fe11939719a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:06 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Volume volume-e2bcc082-285f-4be6-9135-042c8091381b (e2bcc082-285f-4be6-9135-042c8091381b): created successfully Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8791745b-beb7-4d40-809c-fe11939719a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Flow 'volume_create_manager' (70e7979c-51c8-43ae-84ed-b5667ba6ec29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:06 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-477bb097-ea10-4157-aa51-773175cefc8f tempest-VolumesGetTest-494417386 None] Created volume successfully. Sep 09 03:52:06 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825" returned: 0 in 0.430s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b0d97-84a6-4fce-a2b6-c913373ee4c8]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:06 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e Sep 09 03:52:06 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:06 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" returned: 0 in 0.385s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:06 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 Sep 09 03:52:06 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:07 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825" returned: 0 in 0.626s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:07 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825 Sep 09 03:52:07 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-e2bcc082-285f-4be6-9135-042c8091381b-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Lock "cinder-e2bcc082-285f-4be6-9135-042c8091381b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-e2bcc082-285f-4be6-9135-042c8091381b" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-e2bcc082-285f-4be6-9135-042c8091381b" acquired by "delete_volume" :: waited 0.013s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd9ce89-3c4e-4fe2-835d-6968e767e4f5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:07 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e.24bebadd-d406-46e4-8995-562fd7a05825" returned: 0 in 0.371s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-quobyte-24bebadd-d406-46e4-8995-562fd7a05825" released by "_delete_snapshot" :: held 1.963s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-quobyte-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" released by "delete_snapshot" :: held 1.997s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:07 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b Sep 09 03:52:07 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:07 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Created reservations ['020df1c0-8a26-4aad-b87b-41052abb6e27', '3ca6c272-76b0-43ca-bf30-b4f35977b605', '410a27ab-c775-44a7-8a8c-ce5f95056ab2', 'e7a36990-7c56-41b2-a76f-89d79990619e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:52:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Delete snapshot completed successfully. Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-21c44552-e4c0-4d05-87f1-ce4aaea74c4e tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-24bebadd-d406-46e4-8995-562fd7a05825-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:08 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b" returned: 0 in 0.494s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:08 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b Sep 09 03:52:08 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:08 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e2bcc082-285f-4be6-9135-042c8091381b" returned: 0 in 0.314s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-e2bcc082-285f-4be6-9135-042c8091381b" released by "delete_volume" :: held 0.858s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Created reservations ['4a8587d7-0e6c-4c10-a419-024e9ca93b2b', 'c581222e-0139-434f-8088-84c1c7b58c51', '0113a029-d6df-4b31-a548-73011ca25222', 'bacd78bf-0fe6-4edc-b580-f5b973a0032e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:08 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:52:08 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-30caca7b-f894-4c2d-951d-7e285565fefc-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Lock "cinder-30caca7b-f894-4c2d-951d-7e285565fefc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Acquiring lock "cinder-quobyte-30caca7b-f894-4c2d-951d-7e285565fefc" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-30caca7b-f894-4c2d-951d-7e285565fefc" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:08 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.310s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4182aece-6967-4cff-978d-9a4f94840e2f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Deleted volume successfully. Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a423df38-5ce4-4967-8d9a-b425f71289c4 tempest-VolumesGetTest-494417386 None] Lock "cinder-e2bcc082-285f-4be6-9135-042c8091381b-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "cinder-b0060f1b-70a8-419d-9ae0-593dd4f19a7e-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:09 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-b0060f1b-70a8-419d-9ae0-593dd4f19a7e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:09 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "cinder-quobyte-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-quobyte-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" acquired by "delete_volume" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d62e501-c382-441c-a2b5-27d8bfdd6114]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:09 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e Sep 09 03:52:09 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:09 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc" returned: 0 in 0.511s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:09 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc Sep 09 03:52:09 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:09 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" returned: 0 in 0.494s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:09 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e Sep 09 03:52:09 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:09 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-30caca7b-f894-4c2d-951d-7e285565fefc" returned: 0 in 0.326s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Lock "cinder-quobyte-30caca7b-f894-4c2d-951d-7e285565fefc" released by "delete_volume" :: held 0.912s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Created reservations ['5f74e951-617e-4747-aaec-ce73f45ee942', '0ce541ed-c97f-4f44-9def-8cd82d08751d', '2545f2ae-4d18-48f3-96b1-52f751c4ab95', 'a89f8769-340c-499a-a5df-bb07844eebff'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:10 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:52:10 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:10 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" returned: 0 in 0.315s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-quobyte-b0060f1b-70a8-419d-9ae0-593dd4f19a7e" released by "delete_volume" :: held 0.892s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Created reservations ['5c4acde9-1af4-4664-91e6-235d2af953e5', '19483144-4784-487a-967f-d0d8b18efa19', 'e2e10a01-bb65-4e8b-99c6-af04b3fc2631', 'ab62d7a2-5697-4c7c-b9a4-e2a9269637d1'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:10 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:10 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.378s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:52:10 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Deleted volume successfully. Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-70665541-c0d4-4312-b526-d96abd09a69f tempest-VolumesGetTest-494417386 None] Lock "cinder-30caca7b-f894-4c2d-951d-7e285565fefc-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:10 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.367s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:52:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Deleted volume successfully. Sep 09 03:52:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ae900f58-4e07-4636-9414-4f50c9561716 tempest-VolumesSnapshotNegativeTestJSON-755976972 None] Lock "cinder-b0060f1b-70a8-419d-9ae0-593dd4f19a7e-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Flow 'volume_create_manager' (5ed6c1d6-0850-4d58-a40d-1812e0b2581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45790b88-15bb-4afb-99ad-9c933222f46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45790b88-15bb-4afb-99ad-9c933222f46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1048786207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e080317-12aa-4d4b-87ec-2e5355218063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7c1f764fcf40d0ad80b5b0ea4c50cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:14Z,use_quota=True,user_id='deddcb02d9f54d25afa3cae0832b640b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce0f28-7249-4370-aa0b-391aa20c3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce0f28-7249-4370-aa0b-391aa20c3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d192cd0-5cea-412e-a8cf-0b94d479d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d192cd0-5cea-412e-a8cf-0b94d479d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e080317-12aa-4d4b-87ec-2e5355218063', 'volume_name': 'volume-9e080317-12aa-4d4b-87ec-2e5355218063', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdb7c10-1ee3-41e3-b2e0-c134cd39e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdb7c10-1ee3-41e3-b2e0-c134cd39e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3feaf2-4a9a-4732-bd88-7394e899d62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:14 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Volume 9e080317-12aa-4d4b-87ec-2e5355218063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e080317-12aa-4d4b-87ec-2e5355218063', 'volume_size': 1} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1048786207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e080317-12aa-4d4b-87ec-2e5355218063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7c1f764fcf40d0ad80b5b0ea4c50cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:14Z,use_quota=True,user_id='deddcb02d9f54d25afa3cae0832b640b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Creating volume 9e080317-12aa-4d4b-87ec-2e5355218063 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:52:14 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:52:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:14 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 1073741824 Sep 09 03:52:14 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:15 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 1073741824" returned: 0 in 0.584s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:15 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 Sep 09 03:52:15 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:15 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063" returned: 0 in 0.458s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3feaf2-4a9a-4732-bd88-7394e899d62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e080317-12aa-4d4b-87ec-2e5355218063', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9390413e-6535-4b5a-9365-25f5fe7866b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:15 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Volume volume-9e080317-12aa-4d4b-87ec-2e5355218063 (9e080317-12aa-4d4b-87ec-2e5355218063): created successfully Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9390413e-6535-4b5a-9365-25f5fe7866b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Flow 'volume_create_manager' (5ed6c1d6-0850-4d58-a40d-1812e0b2581a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8d39d197-e9ff-4026-ba5b-ebd15ed458b9 tempest-TestImageHashVerification-853820383 None] Created volume successfully. Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-e3a6c195-a662-4ae4-a7a8-0e0c4d4fd74a req-f65f00f4-cf4d-4030-905e-ec1668f37549 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-e3a6c195-a662-4ae4-a7a8-0e0c4d4fd74a req-f65f00f4-cf4d-4030-905e-ec1668f37549 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-e3a6c195-a662-4ae4-a7a8-0e0c4d4fd74a req-f65f00f4-cf4d-4030-905e-ec1668f37549 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-e3a6c195-a662-4ae4-a7a8-0e0c4d4fd74a req-f65f00f4-cf4d-4030-905e-ec1668f37549 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82813dc9-b25d-415b-bb3f-1e7c277e12a2', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:52:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-e3a6c195-a662-4ae4-a7a8-0e0c4d4fd74a req-f65f00f4-cf4d-4030-905e-ec1668f37549 tempest-TestServerVolumeAttachmentScenario-1089655177 None] attachment_update completed successfully. Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Flow 'volume_create_manager' (3a51954a-0909-442f-889e-ca056c2a909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb207a2f-033f-4157-92b2-31ffa1cd794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb207a2f-033f-4157-92b2-31ffa1cd794c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1679312991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd4e7e04cf4bc08317a2cd93dd2571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:16Z,use_quota=True,user_id='e62faee78ac843628935750c3caa4ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b515c8-d8bc-4a24-b2c0-149a4e44ed63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b515c8-d8bc-4a24-b2c0-149a4e44ed63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e5a2d5-248a-43ac-bd26-1cd23c6d34e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e5a2d5-248a-43ac-bd26-1cd23c6d34e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935', 'volume_name': 'volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6dd5f0-b108-402e-bde3-45462a8359d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6dd5f0-b108-402e-bde3-45462a8359d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ff2bc9-d478-4665-9a41-d126d39e6dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:16 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Volume 2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935', 'volume_size': 1} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1679312991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd4e7e04cf4bc08317a2cd93dd2571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:16Z,use_quota=True,user_id='e62faee78ac843628935750c3caa4ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Creating volume 2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:52:16 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:52:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:16 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 1073741824 Sep 09 03:52:16 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:17 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 1073741824" returned: 0 in 0.584s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:17 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 Sep 09 03:52:17 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:17 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" returned: 0 in 0.326s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ff2bc9-d478-4665-9a41-d126d39e6dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce175ebd-fbe0-44a6-8db1-2fb96e2ebc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829737e-98b2-4dbd-808a-5889989b4d41]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:17 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Volume volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 (2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935): created successfully Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce175ebd-fbe0-44a6-8db1-2fb96e2ebc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Flow 'volume_create_manager' (3a51954a-0909-442f-889e-ca056c2a909c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c085dba9-3312-4feb-a1f8-1f0e9324dc2b tempest-VolumesSnapshotListTestJSON-1841650453 None] Created volume successfully. Sep 09 03:52:17 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 Sep 09 03:52:17 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:18 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063" returned: 0 in 0.394s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b554cc-4674-41a2-960d-f547b1a865af]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:18 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 Sep 09 03:52:18 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:18 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063" returned: 0 in 0.397s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 /opt/stack/data/cinder/conversion/9e080317-12aa-4d4b-87ec-2e5355218063.temp_image.baa5895c-9af3-41f6-9316-d7d6a33c5502kphil3hi.img {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:18 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 /opt/stack/data/cinder/conversion/9e080317-12aa-4d4b-87ec-2e5355218063.temp_image.baa5895c-9af3-41f6-9316-d7d6a33c5502kphil3hi.img Sep 09 03:52:18 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-6a35d992-ef2b-48ab-885a-5d7710e9bad4 req-a5b8a62f-746c-4f84-8c2e-374b24948419 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:24 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 /opt/stack/data/cinder/conversion/9e080317-12aa-4d4b-87ec-2e5355218063.temp_image.baa5895c-9af3-41f6-9316-d7d6a33c5502kphil3hi.img" returned: 0 in 5.642s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:24 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6329294-1675-402b-8852-cdffa0e915fd]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:24 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 Sep 09 03:52:24 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:24 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063" returned: 0 in 0.655s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:24 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/conversion/9e080317-12aa-4d4b-87ec-2e5355218063.temp_image.baa5895c-9af3-41f6-9316-d7d6a33c5502kphil3hi.img {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:52:24 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Converted 1024.00 MB image at 181.45 MB/s Sep 09 03:52:24 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] baa5895c-9af3-41f6-9316-d7d6a33c5502 was raw, no need to convert to raw {{(pid=87597) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 03:52:33 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=75,cinder:INSERT=35,cinder:UPDATE=101,cinder:DELETE=11 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:52:34 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=96,cinder:INSERT=28,cinder:UPDATE=112,cinder:DELETE=7 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:37 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:52:37 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:37 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.341s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:52:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:52:45 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:52:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.571s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Uploaded volume to glance image-id: baa5895c-9af3-41f6-9316-d7d6a33c5502. {{(pid=87597) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 03:52:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 27.398s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Creating offline snapshot 89b5df63-fe15-4465-a372-618151c5272a of volume 2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:52:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f65c7110-c6f9-41f6-b894-fc0b4c97d18d tempest-TestImageHashVerification-853820383 None] Copy volume to image completed successfully. Sep 09 03:52:46 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[00281328-6fb0-403d-96fc-5804802b26d5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:46 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 Sep 09 03:52:46 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:46 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" returned: 0 in 0.660s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:46 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a 1G Sep 09 03:52:46 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Acquiring lock "cinder-9e080317-12aa-4d4b-87ec-2e5355218063-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Lock "cinder-9e080317-12aa-4d4b-87ec-2e5355218063-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Acquiring lock "cinder-quobyte-9e080317-12aa-4d4b-87ec-2e5355218063" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Lock "cinder-quobyte-9e080317-12aa-4d4b-87ec-2e5355218063" acquired by "delete_volume" :: waited 0.044s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d76425a-5e1a-4dbb-af14-cf3d419f02cc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:47 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 Sep 09 03:52:47 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:47 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a 1G" returned: 0 in 0.682s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:47 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a Sep 09 03:52:47 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:47 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063" returned: 0 in 0.458s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:47 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063 Sep 09 03:52:47 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:47 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a" returned: 0 in 0.356s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:47 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a is being set with open permissions: ugo+rw Sep 09 03:52:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:47 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a Sep 09 03:52:47 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:48 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9e080317-12aa-4d4b-87ec-2e5355218063" returned: 0 in 0.289s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Lock "cinder-quobyte-9e080317-12aa-4d4b-87ec-2e5355218063" released by "delete_volume" :: held 0.813s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Created reservations ['eebd4765-22e0-4207-9310-3008d0975a1a', 'cce61d90-37a2-4f37-a752-f367201f78e1', '5e08c25c-a38a-42bd-9723-613970ba0209', '158d00c3-c89d-4cee-8a95-e4a6a156bde3'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:52:48 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a" returned: 0 in 0.386s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:48 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:52:48 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:48 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.info Sep 09 03:52:48 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:48 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.371s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:52:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Deleted volume successfully. Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0e401d4f-bcd3-4a48-9bef-17c25d232593 tempest-TestImageHashVerification-853820383 None] Lock "cinder-9e080317-12aa-4d4b-87ec-2e5355218063-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:52:48 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.info" returned: 0 in 0.335s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:48 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.info is being set with open permissions: ugo+rw Sep 09 03:52:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:48 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.info Sep 09 03:52:48 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:49 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.info" returned: 0 in 0.344s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.957s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-6a35d992-ef2b-48ab-885a-5d7710e9bad4 req-a5b8a62f-746c-4f84-8c2e-374b24948419 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.616s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-6a35d992-ef2b-48ab-885a-5d7710e9bad4 req-a5b8a62f-746c-4f84-8c2e-374b24948419 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-01c9d2c8-74cd-44df-aec4-e6a9f48ac455 tempest-VolumesSnapshotListTestJSON-1841650453 None] Create snapshot completed successfully Sep 09 03:52:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-6a35d992-ef2b-48ab-885a-5d7710e9bad4 req-a5b8a62f-746c-4f84-8c2e-374b24948419 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7088598b-6f5d-41de-9f25-6d171d5bcb94', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:52:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-6a35d992-ef2b-48ab-885a-5d7710e9bad4 req-a5b8a62f-746c-4f84-8c2e-374b24948419 tempest-TestServerVolumeAttachmentScenario-1089655177 None] attachment_update completed successfully. Sep 09 03:52:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Creating offline snapshot f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf of volume 2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:52:50 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d47b9b1-1b54-45a8-b09c-6fe6ef19887d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:50 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a Sep 09 03:52:50 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:51 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a" returned: 0 in 0.725s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:52:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:51 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf 1G Sep 09 03:52:51 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:51 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf 1G" returned: 0 in 0.686s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:51 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf Sep 09 03:52:51 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-b00d3abc-87d0-484b-a0a9-277e9d4d1377 req-4e3b1426-e71b-4491-8a2e-076bc39a14fc tempest-TestServerVolumeAttachmentScenario-1089655177 None] Terminate volume connection completed successfully. Sep 09 03:52:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-b00d3abc-87d0-484b-a0a9-277e9d4d1377 req-4e3b1426-e71b-4491-8a2e-076bc39a14fc tempest-TestServerVolumeAttachmentScenario-1089655177 None] Deleting attachment 7088598b-6f5d-41de-9f25-6d171d5bcb94. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:52:52 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" returned: 0 in 0.705s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:52 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf is being set with open permissions: ugo+rw Sep 09 03:52:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:52 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf Sep 09 03:52:52 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:53 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" returned: 0 in 0.445s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:53 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-41775a20-bc92-4f20-9bb2-ba889a51ece7 tempest-VolumesSnapshotListTestJSON-1841650453 None] Create snapshot completed successfully Sep 09 03:52:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Creating offline snapshot bc00e095-cb75-46de-95e7-168725f837eb of volume 2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb3fb82-fc0a-4366-a09c-4ae1151a1aad]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:54 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf Sep 09 03:52:54 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-15154c54-076c-436f-934e-1184bba91612 req-d97e2ace-fa8a-4d4b-bc5c-3e7bb86d36ef tempest-TestServerVolumeAttachmentScenario-1089655177 None] Terminate volume connection completed successfully. Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-15154c54-076c-436f-934e-1184bba91612 req-d97e2ace-fa8a-4d4b-bc5c-3e7bb86d36ef tempest-TestServerVolumeAttachmentScenario-1089655177 None] Deleting attachment 82813dc9-b25d-415b-bb3f-1e7c277e12a2. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:52:54 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" returned: 0 in 0.610s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:54 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb 1G Sep 09 03:52:54 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Flow 'volume_create_manager' (2a84507f-bffa-4ba0-b97b-ccbab03d8a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8a80ac-c7bc-44ba-a14f-9f626894617a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8a80ac-c7bc-44ba-a14f-9f626894617a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-490399253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d300a3-4a0f-4fc6-b210-11e5f7dfc851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98952c1708db4e2da7aa3bf1e71a8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:55Z,use_quota=True,user_id='00546ef665d449b58742488b40596970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f0760a-50c4-4b2d-853b-536f2fb31239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f0760a-50c4-4b2d-853b-536f2fb31239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1baeb794-c8ff-431a-83d9-2093b39b7039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1baeb794-c8ff-431a-83d9-2093b39b7039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d300a3-4a0f-4fc6-b210-11e5f7dfc851', 'volume_name': 'volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b7e529-8eba-4c44-93d6-4e34e21f777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b7e529-8eba-4c44-93d6-4e34e21f777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134b252e-e876-40f3-a379-dbd919610f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:55 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Volume c5d300a3-4a0f-4fc6-b210-11e5f7dfc851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851', 'volume_size': 1} Sep 09 03:52:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:55 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb 1G" returned: 0 in 0.723s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:55 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb Sep 09 03:52:55 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:56 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb" returned: 0 in 0.718s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:56 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb is being set with open permissions: ugo+rw Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:56 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb Sep 09 03:52:56 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:56 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb" returned: 0 in 0.419s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-490399253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d300a3-4a0f-4fc6-b210-11e5f7dfc851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98952c1708db4e2da7aa3bf1e71a8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:52:55Z,use_quota=True,user_id='00546ef665d449b58742488b40596970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Creating volume c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:52:56 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:52:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:56 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 1073741824 Sep 09 03:52:56 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-79c9c5e5-a523-4646-a26d-e6b62d2374c3 tempest-VolumesSnapshotListTestJSON-1841650453 None] Create snapshot completed successfully Sep 09 03:52:57 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 1073741824" returned: 0 in 0.757s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:57 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 Sep 09 03:52:57 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:52:58 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 09 03:52:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851" returned: 0 in 0.680s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:52:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:52:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:52:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134b252e-e876-40f3-a379-dbd919610f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a93367-600f-430a-8da9-3d026f4ff46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:52:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Volume volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 (c5d300a3-4a0f-4fc6-b210-11e5f7dfc851): created successfully Sep 09 03:52:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a93367-600f-430a-8da9-3d026f4ff46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:52:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Flow 'volume_create_manager' (2a84507f-bffa-4ba0-b97b-ccbab03d8a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:52:58 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d0a8e45c-937b-4f3c-b668-f2dbde9792df tempest-TestMinimumBasicScenario-561332143 None] Created volume successfully. Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-bc00e095-cb75-46de-95e7-168725f837eb-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-bc00e095-cb75-46de-95e7-168725f837eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-quobyte-bc00e095-cb75-46de-95e7-168725f837eb" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-bc00e095-cb75-46de-95e7-168725f837eb" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Deleting offline snapshot bc00e095-cb75-46de-95e7-168725f837eb of volume 2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] snapshot_file for this snap is: volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd57c94d-f6b3-4ee2-a7c4-12ba8057b0ee]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:52:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:52:59 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb Sep 09 03:52:59 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:00 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb" returned: 0 in 0.776s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f1e786-16e9-48a3-b43b-7a459f586c2b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:00 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf Sep 09 03:53:00 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-3a4f245d-d24c-49f3-b0f8-4ab144d3ffa1 req-e5b62f5d-41d8-4b93-80e7-6a6f6779a151 tempest-TestMinimumBasicScenario-561332143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-3a4f245d-d24c-49f3-b0f8-4ab144d3ffa1 req-e5b62f5d-41d8-4b93-80e7-6a6f6779a151 tempest-TestMinimumBasicScenario-561332143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-3a4f245d-d24c-49f3-b0f8-4ab144d3ffa1 req-e5b62f5d-41d8-4b93-80e7-6a6f6779a151 tempest-TestMinimumBasicScenario-561332143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-3a4f245d-d24c-49f3-b0f8-4ab144d3ffa1 req-e5b62f5d-41d8-4b93-80e7-6a6f6779a151 tempest-TestMinimumBasicScenario-561332143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8898bd58-0e27-415d-985a-63857a20b94c', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:53:00 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" returned: 0 in 0.752s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:53:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:00 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-3a4f245d-d24c-49f3-b0f8-4ab144d3ffa1 req-e5b62f5d-41d8-4b93-80e7-6a6f6779a151 tempest-TestMinimumBasicScenario-561332143 None] attachment_update completed successfully. Sep 09 03:53:00 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb Sep 09 03:53:00 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "cinder-28dd69e0-4934-4cb3-91ab-9f5861ea2f46-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "cinder-28dd69e0-4934-4cb3-91ab-9f5861ea2f46-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "cinder-quobyte-28dd69e0-4934-4cb3-91ab-9f5861ea2f46" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "cinder-quobyte-28dd69e0-4934-4cb3-91ab-9f5861ea2f46" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd795857-4777-425e-9142-fe95557efd09]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:01 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb" returned: 0 in 0.700s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:01 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb Sep 09 03:53:01 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:01 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 Sep 09 03:53:01 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:01 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.bc00e095-cb75-46de-95e7-168725f837eb" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-bc00e095-cb75-46de-95e7-168725f837eb" released by "_delete_snapshot" :: held 2.730s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" released by "delete_snapshot" :: held 2.779s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Created reservations ['997bb469-be56-4e02-b9bf-a7586ec6e19a', 'd6122757-d1c7-4f19-98e7-11b4e10e4e88', 'd0f2abc7-4ed0-41f4-8e05-2947c861d5d6', '895cd047-96ac-42e0-a852-2e7b976bc9d0'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:02 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46" returned: 0 in 0.593s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:02 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46 Sep 09 03:53:02 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:02 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Delete snapshot completed successfully. Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97be0add-b198-4f46-bd8e-64ed44b07c79 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-bc00e095-cb75-46de-95e7-168725f837eb-delete_snapshot" released by "delete_snapshot" :: held 3.025s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:02 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-28dd69e0-4934-4cb3-91ab-9f5861ea2f46" returned: 0 in 0.451s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-quobyte-f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "cinder-quobyte-28dd69e0-4934-4cb3-91ab-9f5861ea2f46" released by "delete_volume" :: held 1.120s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Deleting offline snapshot f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf of volume 2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] snapshot_file for this snap is: volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf8b0d9-5a50-4326-a088-4303d1ffcef8]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Created reservations ['cfe1effc-56dd-4f4a-b42d-b6e07d3ac8de', '0bcbd9d7-a04c-4ee6-9c1b-441ea1ea4444', 'd4be1396-fe05-4f9a-b7c2-c9ee405a77e3', 'c2d3f4dd-7844-48f2-83d1-f5dc27bdd547'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:02 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf Sep 09 03:53:02 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:02 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:02 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:03 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" returned: 0 in 0.465s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6bb2f1-14ad-4137-9503-7080194f1887]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:03 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.369s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Deleted volume successfully. Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ef5426ba-bd1f-462e-a509-d566a607a69c tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "cinder-28dd69e0-4934-4cb3-91ab-9f5861ea2f46-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:03 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a Sep 09 03:53:03 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:03 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a" returned: 0 in 0.458s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:03 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf Sep 09 03:53:03 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "cinder-e5da6f22-e5b9-4d63-8957-d3020bf1388f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "cinder-e5da6f22-e5b9-4d63-8957-d3020bf1388f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "cinder-quobyte-e5da6f22-e5b9-4d63-8957-d3020bf1388f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "cinder-quobyte-e5da6f22-e5b9-4d63-8957-d3020bf1388f" acquired by "delete_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[457f0228-4c71-47f3-9b58-4ccf1ccae4c7]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:04 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f Sep 09 03:53:04 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:04 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" returned: 0 in 0.729s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:04 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf Sep 09 03:53:04 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:04 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f" returned: 0 in 0.725s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:04 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f Sep 09 03:53:04 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:04 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" returned: 0 in 0.503s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf" released by "_delete_snapshot" :: held 2.324s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" released by "delete_snapshot" :: held 2.368s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Created reservations ['89e35698-c5d1-4e91-87bc-74cea5d4c771', '0b6a5eb9-c60a-424f-a62a-6efa0f630ee6', 'a848b2f2-facf-4a77-ae65-4b11f81f41ba', '9c309e78-160e-412c-ad47-c71e016712a5'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:05 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e5da6f22-e5b9-4d63-8957-d3020bf1388f" returned: 0 in 0.431s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "cinder-quobyte-e5da6f22-e5b9-4d63-8957-d3020bf1388f" released by "delete_volume" :: held 1.206s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:05 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Delete snapshot completed successfully. Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a5b8971e-11e7-47f6-a1fd-fe017678800d tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-f23dbfb2-14c3-406a-b6d0-0dc7ae321dcf-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Created reservations ['f8afaa55-a4e8-45b9-aaa6-fc5a06c1b0d7', '33bca32d-3edc-4ca9-9591-4a88d52fca4f', '0bce59d5-7fcd-40f3-93ca-333dd17404fd', '50364c70-880f-4bde-ba7f-04e3a6144ef3'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:05 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:05 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:05 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.267s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:05 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Deleted volume successfully. Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2910a7b9-164f-4f94-8a7d-de1ebbc77e74 tempest-TestServerVolumeAttachmentScenario-1089655177 None] Lock "cinder-e5da6f22-e5b9-4d63-8957-d3020bf1388f-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-89b5df63-fe15-4465-a372-618151c5272a-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-89b5df63-fe15-4465-a372-618151c5272a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-quobyte-89b5df63-fe15-4465-a372-618151c5272a" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-89b5df63-fe15-4465-a372-618151c5272a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Deleting offline snapshot 89b5df63-fe15-4465-a372-618151c5272a of volume 2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:53:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] snapshot_file for this snap is: volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:53:06 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a212916b-b6be-4edb-aa6b-c0183729b225]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:06 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a Sep 09 03:53:06 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:06 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a" returned: 0 in 0.490s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:53:06 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a372244-892b-46ff-aff5-e2d5aa5c865f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:06 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 Sep 09 03:53:06 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:07 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" returned: 0 in 0.483s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:07 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a Sep 09 03:53:07 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:07 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a" returned: 0 in 0.434s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:07 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a Sep 09 03:53:07 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:07 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935.89b5df63-fe15-4465-a372-618151c5272a" returned: 0 in 0.274s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-89b5df63-fe15-4465-a372-618151c5272a" released by "_delete_snapshot" :: held 1.817s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" released by "delete_snapshot" :: held 1.847s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Created reservations ['121344a6-c511-4943-b491-c7688222f5e8', '22f328b7-b0f1-4020-b710-473d8fd33dce', '1327763b-82e9-4141-b9e6-0a4223c10076', '40bdb52c-0f5d-425a-9f3e-6bb8f3d3ca1a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Delete snapshot completed successfully. Sep 09 03:53:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6b4db0f-151d-4293-97c7-547c73fe244a tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-89b5df63-fe15-4465-a372-618151c5272a-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4451c43b-c0ef-4de9-8681-ccf12c21b566]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:08 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 Sep 09 03:53:08 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:08 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" returned: 0 in 0.438s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:08 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935 Sep 09 03:53:08 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:09 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" returned: 0 in 0.369s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-quobyte-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935" released by "delete_volume" :: held 0.917s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Created reservations ['fb62ccb5-8660-4bc9-8a5b-351d634cd93e', 'ceade1e3-f9b9-40b6-b780-d88efcccfe3f', '2fea4e5b-bc31-42ee-8814-26eb35735859', '84108bf3-e27b-41c6-aa68-15d7abd1c27d'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:09 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:09 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:09 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.395s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Deleted volume successfully. Sep 09 03:53:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-474ae779-6499-4e8f-a642-0411ad984188 tempest-VolumesSnapshotListTestJSON-1841650453 None] Lock "cinder-2e92fff1-d4cd-4cdf-b3a5-1e21ce5d7935-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (f8c0f5af-9923-4651-8fa0-0255144748fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53bb8d51-649a-4e69-aafc-dd77d1426efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53bb8d51-649a-4e69-aafc-dd77d1426efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1179679445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ec70f3-8c21-4b81-8697-56f8952e9245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:10Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e1f4dc-41f5-441e-a662-f11a6dfe43e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e1f4dc-41f5-441e-a662-f11a6dfe43e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed2d5e5-8042-4e58-9f98-b5714a2695dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed2d5e5-8042-4e58-9f98-b5714a2695dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ec70f3-8c21-4b81-8697-56f8952e9245', 'volume_name': 'volume-d6ec70f3-8c21-4b81-8697-56f8952e9245', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9f349d-1ac0-4ff4-98fc-22b975eefc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9f349d-1ac0-4ff4-98fc-22b975eefc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea47a62-75ce-4fb4-8864-cfce8dee7fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Volume d6ec70f3-8c21-4b81-8697-56f8952e9245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ec70f3-8c21-4b81-8697-56f8952e9245', 'volume_size': 1} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1179679445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ec70f3-8c21-4b81-8697-56f8952e9245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:10Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Creating volume d6ec70f3-8c21-4b81-8697-56f8952e9245 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:10 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:10 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 1073741824 Sep 09 03:53:10 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (03913556-d012-40b9-9433-7627150bdc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f261e2fe-1c6c-43ed-bd18-362340e8471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f261e2fe-1c6c-43ed-bd18-362340e8471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2085051149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4320314-9bcb-43e3-b4ed-8c5732d9f4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:11Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22937c65-d457-415b-aae1-d6801adfb193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22937c65-d457-415b-aae1-d6801adfb193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e7f252-c387-4ac5-aec7-03f7ec8057b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e7f252-c387-4ac5-aec7-03f7ec8057b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4320314-9bcb-43e3-b4ed-8c5732d9f4f7', 'volume_name': 'volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6686537-ef99-4fea-8b8f-992155fb860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6686537-ef99-4fea-8b8f-992155fb860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b756d0-9a8c-4243-9d23-ffe40210d24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:11 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Volume f4320314-9bcb-43e3-b4ed-8c5732d9f4f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7', 'volume_size': 1} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:11 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 1073741824" returned: 0 in 0.764s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:11 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 Sep 09 03:53:11 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (aae9a894-ff3c-4c07-af53-31d0931cfab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3861a4-4e74-425b-b8a0-7ed7cca40e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3861a4-4e74-425b-b8a0-7ed7cca40e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278993638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c6fbd6-29f4-4e2e-b005-76465bc81ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:12Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294d9272-80bc-4ddc-98c9-ea12f971c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294d9272-80bc-4ddc-98c9-ea12f971c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:11 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b159a77b-012d-42cc-a124-cabdac72c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b159a77b-012d-42cc-a124-cabdac72c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c6fbd6-29f4-4e2e-b005-76465bc81ae1', 'volume_name': 'volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a213dc9c-eb6d-4425-a357-32b58ee7492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a213dc9c-eb6d-4425-a357-32b58ee7492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7820715-6748-4b1d-923a-4af6e0b913e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:11 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Volume 11c6fbd6-29f4-4e2e-b005-76465bc81ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1', 'volume_size': 1} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245" returned: 0 in 0.557s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2085051149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4320314-9bcb-43e3-b4ed-8c5732d9f4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:11Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Creating volume f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:11 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:11 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 1073741824 Sep 09 03:53:11 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea47a62-75ce-4fb4-8864-cfce8dee7fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ec70f3-8c21-4b81-8697-56f8952e9245', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8538bbe2-f1cf-4bc4-83cb-2ea97d77f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:11 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Volume volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 (d6ec70f3-8c21-4b81-8697-56f8952e9245): created successfully Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8538bbe2-f1cf-4bc4-83cb-2ea97d77f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (f8c0f5af-9923-4651-8fa0-0255144748fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:11 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c89b8962-586c-408e-971b-4749c0aefc74 tempest-CreateVolumesFromImageTest-2073645300 None] Created volume successfully. Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (ba135c5e-59ff-4dde-a578-396000d63780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabf0fc9-b9b4-4a4c-b48f-a0f67a984cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabf0fc9-b9b4-4a4c-b48f-a0f67a984cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1707100319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be2806f-bdba-4d4c-8985-49a0d057a965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:12Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512462ac-82f7-4cc2-beb7-44386563e597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512462ac-82f7-4cc2-beb7-44386563e597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65007a52-a0db-4013-9431-5cf0099e711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65007a52-a0db-4013-9431-5cf0099e711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be2806f-bdba-4d4c-8985-49a0d057a965', 'volume_name': 'volume-4be2806f-bdba-4d4c-8985-49a0d057a965', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a698efe-dbf0-41bb-a961-37314e0ef881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a698efe-dbf0-41bb-a961-37314e0ef881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a277e5-9bce-40ba-9343-a75785a6090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Volume 4be2806f-bdba-4d4c-8985-49a0d057a965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be2806f-bdba-4d4c-8985-49a0d057a965', 'volume_size': 1} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:12 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 1073741824" returned: 0 in 0.701s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:12 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 Sep 09 03:53:12 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (824cea96-4b9c-43e2-b733-f15bb322bb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62a3a0f-6452-4331-8b27-fe7fdfb2adb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62a3a0f-6452-4331-8b27-fe7fdfb2adb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014031395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ad7d6b-a2c0-4db1-8692-b070b1736c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:13Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56baf1f-fa31-4eaa-a943-e4445b574eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56baf1f-fa31-4eaa-a943-e4445b574eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828b4d5f-bce4-4afc-a4be-058abb691d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828b4d5f-bce4-4afc-a4be-058abb691d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ad7d6b-a2c0-4db1-8692-b070b1736c20', 'volume_name': 'volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b26f56-fd9b-4e19-a2c0-114d63f8e15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b26f56-fd9b-4e19-a2c0-114d63f8e15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e157418-679c-4cf3-86f9-c7b2a9899e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Volume 19ad7d6b-a2c0-4db1-8692-b070b1736c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20', 'volume_size': 1} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:12 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7" returned: 0 in 0.321s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278993638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c6fbd6-29f4-4e2e-b005-76465bc81ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:12Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Creating volume 11c6fbd6-29f4-4e2e-b005-76465bc81ae1 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:12 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:12 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 1073741824 Sep 09 03:53:12 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b756d0-9a8c-4243-9d23-ffe40210d24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29426f63-f1b4-4340-bf1f-28397a856be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:12 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Volume volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 (f4320314-9bcb-43e3-b4ed-8c5732d9f4f7): created successfully Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29426f63-f1b4-4340-bf1f-28397a856be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (03913556-d012-40b9-9433-7627150bdc73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-53bdc472-4565-4149-9e0b-6bb448b1c6f2 tempest-CreateVolumesFromImageTest-2073645300 None] Created volume successfully. Sep 09 03:53:13 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 1073741824" returned: 0 in 0.804s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:13 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 Sep 09 03:53:13 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:14 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1" returned: 0 in 0.352s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1707100319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be2806f-bdba-4d4c-8985-49a0d057a965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:12Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Creating volume 4be2806f-bdba-4d4c-8985-49a0d057a965 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:14 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7820715-6748-4b1d-923a-4af6e0b913e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5d3ba7-6b70-4c2f-bc91-2ad3acab0fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:14 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 1073741824 Sep 09 03:53:14 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:14 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Volume volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 (11c6fbd6-29f4-4e2e-b005-76465bc81ae1): created successfully Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5d3ba7-6b70-4c2f-bc91-2ad3acab0fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (aae9a894-ff3c-4c07-af53-31d0931cfab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8636426a-9b4a-4b95-89ba-c6f23d7f117b tempest-CreateVolumesFromImageTest-2073645300 None] Created volume successfully. Sep 09 03:53:14 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 1073741824" returned: 0 in 0.642s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:14 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 Sep 09 03:53:14 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:15 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965" returned: 0 in 0.386s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.406s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014031395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ad7d6b-a2c0-4db1-8692-b070b1736c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2a85ec35a14b8781e1f8da77176902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:13Z,use_quota=True,user_id='0928af000f2d40abaf18ca4f00040a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Creating volume 19ad7d6b-a2c0-4db1-8692-b070b1736c20 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:15 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a277e5-9bce-40ba-9343-a75785a6090e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be2806f-bdba-4d4c-8985-49a0d057a965', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:15 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 1073741824 Sep 09 03:53:15 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b33b6e0-8a0c-4c62-b7e5-05c99256855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:15 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Volume volume-4be2806f-bdba-4d4c-8985-49a0d057a965 (4be2806f-bdba-4d4c-8985-49a0d057a965): created successfully Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b33b6e0-8a0c-4c62-b7e5-05c99256855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (ba135c5e-59ff-4dde-a578-396000d63780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f66a1384-9c01-4c13-b749-f4772cd214ea tempest-CreateVolumesFromImageTest-2073645300 None] Created volume successfully. Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (1bb29730-97ca-4708-942c-14a50099a9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06aee8a-c52a-4115-9295-b9c17999de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06aee8a-c52a-4115-9295-b9c17999de3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1574862634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bdba00-6a34-4723-9fae-a72bf85ef86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:15Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8536b1c4-8472-41b9-86f9-233a0bda824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8536b1c4-8472-41b9-86f9-233a0bda824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a10d52-e5bd-40cc-aeb8-70c59126573c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a10d52-e5bd-40cc-aeb8-70c59126573c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57bdba00-6a34-4723-9fae-a72bf85ef86e', 'volume_name': 'volume-57bdba00-6a34-4723-9fae-a72bf85ef86e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09103cc6-c087-482e-b7ca-d5da1767cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09103cc6-c087-482e-b7ca-d5da1767cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c12cab-8b85-4180-8872-b17c181e3451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:15 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume 57bdba00-6a34-4723-9fae-a72bf85ef86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57bdba00-6a34-4723-9fae-a72bf85ef86e', 'volume_size': 1} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:15 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 1073741824" returned: 0 in 0.520s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:15 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 Sep 09 03:53:15 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:16 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20" returned: 0 in 0.283s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1574862634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bdba00-6a34-4723-9fae-a72bf85ef86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:15Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Creating volume 57bdba00-6a34-4723-9fae-a72bf85ef86e {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:16 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:16 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e 1073741824 Sep 09 03:53:16 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e157418-679c-4cf3-86f9-c7b2a9899e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad568a12-3c99-4005-91b7-e0c07bccb6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:16 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Volume volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 (19ad7d6b-a2c0-4db1-8692-b070b1736c20): created successfully Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad568a12-3c99-4005-91b7-e0c07bccb6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Flow 'volume_create_manager' (824cea96-4b9c-43e2-b733-f15bb322bb48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0d815e94-62c5-420b-8e6a-625c17968133 tempest-CreateVolumesFromImageTest-2073645300 None] Created volume successfully. Sep 09 03:53:16 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e 1073741824" returned: 0 in 0.652s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:16 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e Sep 09 03:53:16 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:17 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e" returned: 0 in 0.291s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c12cab-8b85-4180-8872-b17c181e3451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57bdba00-6a34-4723-9fae-a72bf85ef86e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d308da77-fd9a-4c5d-ba07-ff7cc2e2ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:17 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume volume-57bdba00-6a34-4723-9fae-a72bf85ef86e (57bdba00-6a34-4723-9fae-a72bf85ef86e): created successfully Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d308da77-fd9a-4c5d-ba07-ff7cc2e2ca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (1bb29730-97ca-4708-942c-14a50099a9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-51ef4db1-8573-42b8-a17b-5a908bd61e89 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created volume successfully. Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-19ad7d6b-a2c0-4db1-8692-b070b1736c20-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-19ad7d6b-a2c0-4db1-8692-b070b1736c20-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-quobyte-19ad7d6b-a2c0-4db1-8692-b070b1736c20" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-19ad7d6b-a2c0-4db1-8692-b070b1736c20" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5566f578-c14b-4900-a52c-41904507d8f6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:17 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 Sep 09 03:53:17 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:17 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20" returned: 0 in 0.442s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:17 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20 Sep 09 03:53:17 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Creating offline snapshot 346d7fbe-ff8d-4d79-9fb2-9563e69eff07 of volume 57bdba00-6a34-4723-9fae-a72bf85ef86e {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e881e-5b63-4a00-aae4-4dc895897f74]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:18 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e Sep 09 03:53:18 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:18 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-19ad7d6b-a2c0-4db1-8692-b070b1736c20" returned: 0 in 0.372s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-19ad7d6b-a2c0-4db1-8692-b070b1736c20" released by "delete_volume" :: held 0.862s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Created reservations ['2b4cb281-0847-45b6-b013-42459f250dc5', '78902067-83fd-4446-a4cd-9ce33cddcf8b', '1585f325-185d-4d33-8aae-016dc6564d13', 'd6ee21c2-77a2-411b-9931-54d43083bd47'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:18 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e" returned: 0 in 0.506s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:18 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:18 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:18 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 1G Sep 09 03:53:18 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-4be2806f-bdba-4d4c-8985-49a0d057a965-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-4be2806f-bdba-4d4c-8985-49a0d057a965-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-quobyte-4be2806f-bdba-4d4c-8985-49a0d057a965" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-4be2806f-bdba-4d4c-8985-49a0d057a965" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de94759-c267-46ac-befc-e9ed70b4a594]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:18 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.337s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:18 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Deleted volume successfully. Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4f5905fb-9c7b-445a-9f95-993b1cefb7cf tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-19ad7d6b-a2c0-4db1-8692-b070b1736c20-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:18 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 Sep 09 03:53:18 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:18 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 1G" returned: 0 in 0.547s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57bdba00-6a34-4723-9fae-a72bf85ef86e -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:18 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57bdba00-6a34-4723-9fae-a72bf85ef86e -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 Sep 09 03:53:18 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:19 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965" returned: 0 in 0.476s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:19 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965 Sep 09 03:53:19 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:19 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57bdba00-6a34-4723-9fae-a72bf85ef86e -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07" returned: 0 in 0.437s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:19 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 is being set with open permissions: ugo+rw Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:19 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 Sep 09 03:53:19 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:19 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4be2806f-bdba-4d4c-8985-49a0d057a965" returned: 0 in 0.321s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-4be2806f-bdba-4d4c-8985-49a0d057a965" released by "delete_volume" :: held 0.861s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Created reservations ['9d5186a7-3bde-4712-ba02-91fc26598bad', '0c5d0ca2-754d-4377-acbf-0cf9e4765e13', '4069f203-7453-4105-bbc9-0082e03c5be2', '19138d26-acaa-40f2-9de1-a45a909788d2'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:19 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:19 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-11c6fbd6-29f4-4e2e-b005-76465bc81ae1-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-11c6fbd6-29f4-4e2e-b005-76465bc81ae1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:19 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07" returned: 0 in 0.356s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-quobyte-11c6fbd6-29f4-4e2e-b005-76465bc81ae1" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-11c6fbd6-29f4-4e2e-b005-76465bc81ae1" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:19 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.info Sep 09 03:53:19 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8660e7-4601-4a1b-ad3b-4bf0d964f44c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:19 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.319s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Deleted volume successfully. Sep 09 03:53:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-97307ad9-7fec-4532-9329-7aa141c0c620 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-4be2806f-bdba-4d4c-8985-49a0d057a965-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:20 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 Sep 09 03:53:20 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:20 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.info" returned: 0 in 0.307s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:20 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.info is being set with open permissions: ugo+rw Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:20 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.info Sep 09 03:53:20 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:20 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1" returned: 0 in 0.465s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:20 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1 Sep 09 03:53:20 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:20 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.info" returned: 0 in 0.335s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:20 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-268e3776-d736-4153-91b0-736360be0926 tempest-CreateVolumesFromSnapshotTest-644101158 None] Create snapshot completed successfully Sep 09 03:53:20 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-11c6fbd6-29f4-4e2e-b005-76465bc81ae1" returned: 0 in 0.355s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-11c6fbd6-29f4-4e2e-b005-76465bc81ae1" released by "delete_volume" :: held 0.880s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Created reservations ['b51df63b-aaee-476a-97b8-ca1934c2f600', '7c5ceb7b-e4c2-46bd-b9b3-7f2d31be125e', 'f15dd60c-80b9-4881-beb4-9024148e8e84', '50747a18-7faa-497b-85e4-1e445691a8e7'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:20 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:20 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-quobyte-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d86f6d4-f5b5-4d0c-add4-e52e4544989c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:21 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.579s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:21 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 Sep 09 03:53:21 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:21 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Deleted volume successfully. Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7b885e66-b57f-4855-a6f5-3888fe861d6e tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-11c6fbd6-29f4-4e2e-b005-76465bc81ae1-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:21 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (cc20a077-c40c-4142-a53a-7b5ada0518d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce4b4b6-220e-43b8-9a06-1e8e6a74dbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7" returned: 0 in 0.802s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce4b4b6-220e-43b8-9a06-1e8e6a74dbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1055950165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9120a574-7514-4dca-a0c0-bf862f94e3fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:22Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a89c2e-4810-4af4-819c-34028d307374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a89c2e-4810-4af4-819c-34028d307374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8256f5ec-39fd-415b-a953-70e9cd645955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8256f5ec-39fd-415b-a953-70e9cd645955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9120a574-7514-4dca-a0c0-bf862f94e3fc', 'volume_name': 'volume-9120a574-7514-4dca-a0c0-bf862f94e3fc', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:22 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7 Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dddbb3e-b93f-4556-808f-b8c883941718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dddbb3e-b93f-4556-808f-b8c883941718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da19439-4a97-4d7b-ba3e-503c46e739ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume 9120a574-7514-4dca-a0c0-bf862f94e3fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9120a574-7514-4dca-a0c0-bf862f94e3fc', 'volume_size': 1} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1055950165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9120a574-7514-4dca-a0c0-bf862f94e3fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:22Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Creating volume 9120a574-7514-4dca-a0c0-bf862f94e3fc {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:22 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:22 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc 1073741824 Sep 09 03:53:22 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (23049242-543c-4642-8856-c86aae690c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:22 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444d125c-f901-4c93-9b64-974b574f3a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7" returned: 0 in 0.762s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444d125c-f901-4c93-9b64-974b574f3a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1628199255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:23Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765ba06c-cad0-4ebe-9ae6-dfda2056e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765ba06c-cad0-4ebe-9ae6-dfda2056e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0c9781-2aa0-45d1-ad6e-9be7484b3d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0c9781-2aa0-45d1-ad6e-9be7484b3d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb', 'volume_name': 'volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f4dfd4-8248-4eb7-818d-05596e8fc20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f4dfd4-8248-4eb7-818d-05596e8fc20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e8a6e4-4e42-4736-b405-2bc3593951ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:22 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume 9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb', 'volume_size': 1} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7" released by "delete_volume" :: held 1.747s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Created reservations ['cb9520c3-0443-488b-9e9f-66b573c849d2', 'a4436e87-32dd-4d8b-80de-7487b9f29fe7', 'd00c2b71-e513-46e4-894f-ff7f5a1b5355', '8f024999-7910-4a51-9474-634fb34a4a29'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:22 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc 1073741824" returned: 0 in 0.819s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:23 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc Sep 09 03:53:23 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:23 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:23 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-d6ec70f3-8c21-4b81-8697-56f8952e9245-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:23 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc" returned: 0 in 0.515s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-d6ec70f3-8c21-4b81-8697-56f8952e9245-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1628199255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:23Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Creating volume 9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:23 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da19439-4a97-4d7b-ba3e-503c46e739ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9120a574-7514-4dca-a0c0-bf862f94e3fc', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:23 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb 1073741824 Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc00a300-b281-4bb8-9a1b-0ed5b6251e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:23 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:23 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume volume-9120a574-7514-4dca-a0c0-bf862f94e3fc (9120a574-7514-4dca-a0c0-bf862f94e3fc): created successfully Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc00a300-b281-4bb8-9a1b-0ed5b6251e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:23 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (cc20a077-c40c-4142-a53a-7b5ada0518d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "cinder-quobyte-d6ec70f3-8c21-4b81-8697-56f8952e9245" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (0675fee7-c2db-40a4-8639-935ba29b5553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abba99c3-8e7c-4ea6-a614-108be4dcac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.801s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:23 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Deleted volume successfully. Sep 09 03:53:23 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-540ca587-5865-41cf-a6a9-2efdeadb69cf tempest-CreateVolumesFromSnapshotTest-644101158 None] Created volume successfully. Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abba99c3-8e7c-4ea6-a614-108be4dcac7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-688954025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1068fc2c-e0bf-403a-b7d9-c695ceee948c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:24Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85760b8d-0b90-4cdf-a526-436884c17ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85760b8d-0b90-4cdf-a526-436884c17ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92488b2c-ed60-462e-842f-a25034e97979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92488b2c-ed60-462e-842f-a25034e97979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1068fc2c-e0bf-403a-b7d9-c695ceee948c', 'volume_name': 'volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16aeb2e3-0097-4a57-a13c-5b9ba1fb8a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16aeb2e3-0097-4a57-a13c-5b9ba1fb8a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956a74f0-87d2-448e-89b6-d3984393a348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:23 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume 1068fc2c-e0bf-403a-b7d9-c695ceee948c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c', 'volume_size': 1} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-d6ec70f3-8c21-4b81-8697-56f8952e9245" acquired by "delete_volume" :: waited 0.158s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f32ed7e9-9355-4c01-82cc-b71d922fc451 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-f4320314-9bcb-43e3-b4ed-8c5732d9f4f7-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[72db4f66-6fe9-436d-a2be-80f4fd90cc9c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:24 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 Sep 09 03:53:24 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (f91d2380-90c8-4cfa-b9d3-b24e1195b583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a04318a-f184-458b-af80-11c20abb577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a04318a-f184-458b-af80-11c20abb577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-901444332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6757b0-4c7b-49cd-bdaa-b60b3067f174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:24Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd6c975-7045-407b-9ac3-ff674b94070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd6c975-7045-407b-9ac3-ff674b94070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956d6ce6-a236-49d3-8bd6-e39f9bed9e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956d6ce6-a236-49d3-8bd6-e39f9bed9e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6757b0-4c7b-49cd-bdaa-b60b3067f174', 'volume_name': 'volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8450306-a827-42e4-996e-16e84bca5b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:24 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8450306-a827-42e4-996e-16e84bca5b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c09f7b4-61fe-4b0e-8818-1e73e523e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:24 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume 1d6757b0-4c7b-49cd-bdaa-b60b3067f174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174', 'volume_size': 1} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb 1073741824" returned: 0 in 1.180s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:24 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb Sep 09 03:53:24 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:25 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245" returned: 0 in 0.995s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:25 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245 Sep 09 03:53:25 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (57703643-e88b-4be8-99a8-88dd7dce1d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13df457c-59d2-4562-94f4-dbcf13502115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13df457c-59d2-4562-94f4-dbcf13502115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111943518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:25Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01be742d-429d-4747-ae0e-c2a3ba6eb7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:25 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01be742d-429d-4747-ae0e-c2a3ba6eb7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596400b9-5a64-4fbd-af35-850cf8dd9696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596400b9-5a64-4fbd-af35-850cf8dd9696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01', 'volume_name': 'volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90ade7d-02a3-48e3-8385-9082e4534859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90ade7d-02a3-48e3-8385-9082e4534859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dbe2e4-9473-4b9b-8402-965a61810383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:25 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume 9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01', 'volume_size': 1} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb" returned: 0 in 0.582s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-688954025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1068fc2c-e0bf-403a-b7d9-c695ceee948c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:24Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Creating volume 1068fc2c-e0bf-403a-b7d9-c695ceee948c {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:25 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e8a6e4-4e42-4736-b405-2bc3593951ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a96ad1c-df07-4767-bf83-0e6ecdea4893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:25 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c 1073741824 Sep 09 03:53:25 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:25 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb (9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb): created successfully Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a96ad1c-df07-4767-bf83-0e6ecdea4893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:25 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (23049242-543c-4642-8856-c86aae690c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d6ec70f3-8c21-4b81-8697-56f8952e9245" returned: 0 in 0.493s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:25 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d993820a-16d4-4e4f-b9b3-cbd36d28b8f5 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created volume successfully. Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-quobyte-d6ec70f3-8c21-4b81-8697-56f8952e9245" released by "delete_volume" :: held 1.576s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Created reservations ['95cd29ff-e98f-4767-a50a-2f41725d2b5c', 'e49550cf-e279-438d-8ed0-19d5ab24932a', '2b5fd8a3-2a8b-4681-8ead-ba745c52c52b', '72776b72-f769-4db5-bf56-430fc18c3506'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:25 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:25 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:26 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c 1073741824" returned: 0 in 0.612s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:26 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c Sep 09 03:53:26 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:26 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.479s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:26 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Deleted volume successfully. Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6e914325-8c24-489b-a661-db7fb4208320 tempest-CreateVolumesFromImageTest-2073645300 None] Lock "cinder-d6ec70f3-8c21-4b81-8697-56f8952e9245-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:26 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c" returned: 0 in 0.412s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-901444332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6757b0-4c7b-49cd-bdaa-b60b3067f174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:24Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Creating volume 1d6757b0-4c7b-49cd-bdaa-b60b3067f174 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:26 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956a74f0-87d2-448e-89b6-d3984393a348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b78699-bb11-4940-a5c7-ca3d36a9af1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:26 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c (1068fc2c-e0bf-403a-b7d9-c695ceee948c): created successfully Sep 09 03:53:26 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 1073741824 Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b78699-bb11-4940-a5c7-ca3d36a9af1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:26 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (0675fee7-c2db-40a4-8639-935ba29b5553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:26 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-98a7f5ea-d670-4705-8266-0ff4d437d43f tempest-CreateVolumesFromSnapshotTest-644101158 None] Created volume successfully. Sep 09 03:53:27 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 1073741824" returned: 0 in 0.716s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:27 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 Sep 09 03:53:27 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:27 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174" returned: 0 in 0.330s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.267s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111943518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9249ba1d3eba4dcb8e0591381deff317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:25Z,use_quota=True,user_id='7a6c669f8b7c4f6d8052f62c0c439557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Creating volume 9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:27 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:27 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 1073741824 Sep 09 03:53:27 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c09f7b4-61fe-4b0e-8818-1e73e523e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e80a3e8-2cdc-4a26-b8ea-daab9d60c7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:27 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 (1d6757b0-4c7b-49cd-bdaa-b60b3067f174): created successfully Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e80a3e8-2cdc-4a26-b8ea-daab9d60c7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (f91d2380-90c8-4cfa-b9d3-b24e1195b583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:27 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0970aea4-8c46-4533-8ce8-25652dbb2d50 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created volume successfully. Sep 09 03:53:28 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 1073741824" returned: 0 in 0.627s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:28 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 Sep 09 03:53:28 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:28 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01" returned: 0 in 0.377s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dbe2e4-9473-4b9b-8402-965a61810383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1836e274-0806-4341-bc94-3ac500936514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:28 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Volume volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 (9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01): created successfully Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1836e274-0806-4341-bc94-3ac500936514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Flow 'volume_create_manager' (57703643-e88b-4be8-99a8-88dd7dce1d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:28 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cc9bfee6-75c3-4b56-a7af-a28c61d37884 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created volume successfully. Sep 09 03:53:29 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:29 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:29 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-quobyte-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:29 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:29 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2f4a50-8549-493d-9ed4-5a4860a6d84e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:29 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 Sep 09 03:53:29 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:29 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01" returned: 0 in 0.597s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:29 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01 Sep 09 03:53:29 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:30 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01" returned: 0 in 0.296s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01" released by "delete_volume" :: held 0.953s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created reservations ['a6728557-395e-4b27-ae88-015ee3e89d5d', '411b5c55-7531-4310-acfd-10db5e1bdf6a', 'e65760fd-85e8-4f75-adb3-f5d0490011c6', '78329a7c-288f-441a-89d1-cb01e2bc978e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:30 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:30 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:30 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.402s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:30 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Deleted volume successfully. Sep 09 03:53:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-37a3b8fa-4ec4-4a44-a60d-71dddb3ef5a0 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-9ffb2dfe-2e9c-43d8-abc3-fc40fdb78e01-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (c8815d43-d626-42db-b5f8-d9cd31a08dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fb2918-9a96-4392-ba63-8c79dbe63d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fb2918-9a96-4392-ba63-8c79dbe63d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1041566758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167483b3-e158-4c21-b849-2e755e1a401f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:31Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90ca41b-71ad-4bb6-ab18-a6e9367154ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90ca41b-71ad-4bb6-ab18-a6e9367154ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da2902a-6c97-4993-b1ea-5cbba91a3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da2902a-6c97-4993-b1ea-5cbba91a3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167483b3-e158-4c21-b849-2e755e1a401f', 'volume_name': 'volume-167483b3-e158-4c21-b849-2e755e1a401f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bed58e1-f70d-4a75-a32b-c0143b25089c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bed58e1-f70d-4a75-a32b-c0143b25089c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da83215-9545-4cc2-a048-9d73a917d938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:31 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume 167483b3-e158-4c21-b849-2e755e1a401f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167483b3-e158-4c21-b849-2e755e1a401f', 'volume_size': 1} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1041566758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167483b3-e158-4c21-b849-2e755e1a401f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:31Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Creating volume 167483b3-e158-4c21-b849-2e755e1a401f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:31 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:31 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f 1073741824 Sep 09 03:53:31 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-1d6757b0-4c7b-49cd-bdaa-b60b3067f174-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-1d6757b0-4c7b-49cd-bdaa-b60b3067f174-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-quobyte-1d6757b0-4c7b-49cd-bdaa-b60b3067f174" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-1d6757b0-4c7b-49cd-bdaa-b60b3067f174" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6431aed8-6eee-4162-a2d1-f6dd7cbe384c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:31 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 Sep 09 03:53:31 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:32 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f 1073741824" returned: 0 in 0.859s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:32 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f Sep 09 03:53:32 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:32 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174" returned: 0 in 0.576s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:32 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174 Sep 09 03:53:32 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:32 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1d6757b0-4c7b-49cd-bdaa-b60b3067f174" returned: 0 in 0.343s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:32 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f" returned: 0 in 0.538s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-1d6757b0-4c7b-49cd-bdaa-b60b3067f174" released by "delete_volume" :: held 0.989s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da83215-9545-4cc2-a048-9d73a917d938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167483b3-e158-4c21-b849-2e755e1a401f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981f8b06-0b89-4ad1-a963-74c10131371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume volume-167483b3-e158-4c21-b849-2e755e1a401f (167483b3-e158-4c21-b849-2e755e1a401f): created successfully Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981f8b06-0b89-4ad1-a963-74c10131371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (c8815d43-d626-42db-b5f8-d9cd31a08dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ff152122-afcd-41a1-ad1b-439ecc9e6f9c tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created volume successfully. Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created reservations ['cf3034e0-3b33-4991-9182-48a7e4c06068', 'e0c124f8-8bc3-4765-b268-e5744ec8d05e', 'f57ec137-3772-42b8-942c-720a8175acbf', '4235e0ce-4398-4a50-8ece-1c954bbe6317'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:32 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:32 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:33 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.598s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:33 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:33 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Deleted volume successfully. Sep 09 03:53:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f7045912-c03c-4791-b46c-f43f5cd6a2d8 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-1d6757b0-4c7b-49cd-bdaa-b60b3067f174-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-1068fc2c-e0bf-403a-b7d9-c695ceee948c-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (2c032ebe-e13a-431f-a667-cbcdaf94e465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359962a6-783b-4ead-9a9f-70ea8f3be10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-1068fc2c-e0bf-403a-b7d9-c695ceee948c-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359962a6-783b-4ead-9a9f-70ea8f3be10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-101051429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad73a147-f6d7-486a-b857-ffaf49529d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:34Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b892e9e4-4b47-4111-a28e-556c6b47a0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b892e9e4-4b47-4111-a28e-556c6b47a0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d63043-c159-4b84-9e53-2ed064fbc9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d63043-c159-4b84-9e53-2ed064fbc9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad73a147-f6d7-486a-b857-ffaf49529d9d', 'volume_name': 'volume-ad73a147-f6d7-486a-b857-ffaf49529d9d', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8230d42d-2f81-4c39-b97c-f9ebd452b75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8230d42d-2f81-4c39-b97c-f9ebd452b75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad955599-bd89-4429-909d-8b019490f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:34 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume ad73a147-f6d7-486a-b857-ffaf49529d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad73a147-f6d7-486a-b857-ffaf49529d9d', 'volume_size': 1} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-101051429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad73a147-f6d7-486a-b857-ffaf49529d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:34Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Creating volume ad73a147-f6d7-486a-b857-ffaf49529d9d {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:34 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:34 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d 1073741824 Sep 09 03:53:34 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-quobyte-1068fc2c-e0bf-403a-b7d9-c695ceee948c" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-1068fc2c-e0bf-403a-b7d9-c695ceee948c" acquired by "delete_volume" :: waited 0.066s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef4e8b-6195-4754-8c78-5eb659253f29]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:34 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c Sep 09 03:53:34 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:34 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (8081e014-7993-4973-b71f-eba2eb211551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8797b3db-8f55-463c-87b8-333f404d0fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8797b3db-8f55-463c-87b8-333f404d0fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-711101465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2da39ad-89ed-4224-9c81-bfc14ea85fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:35Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f0c834-67c6-4c0a-88a7-bf26c1fa04fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f0c834-67c6-4c0a-88a7-bf26c1fa04fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f7bd20-244e-43bc-894a-bcd2cf5671ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f7bd20-244e-43bc-894a-bcd2cf5671ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2da39ad-89ed-4224-9c81-bfc14ea85fb0', 'volume_name': 'volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b51283-3736-4379-ae71-d4633addcc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b51283-3736-4379-ae71-d4633addcc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07188e6-eb11-4589-bf49-85d753eeaa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume f2da39ad-89ed-4224-9c81-bfc14ea85fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0', 'volume_size': 1} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d 1073741824" returned: 0 in 1.006s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:35 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d Sep 09 03:53:35 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (39c0cf6f-a75f-4674-b731-ff52b11ce88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3a0b8f-05e2-43b0-a59c-7084e8c21500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3a0b8f-05e2-43b0-a59c-7084e8c21500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438302782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:35Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66a4f74-e6f6-4e53-8f59-56cd035c5a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66a4f74-e6f6-4e53-8f59-56cd035c5a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31827e8a-ec51-4967-b530-faf8598eae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31827e8a-ec51-4967-b530-faf8598eae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3', 'volume_name': 'volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7552c2-280f-40cc-8a31-6c3d3cca7422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7552c2-280f-40cc-8a31-6c3d3cca7422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472aa541-17f9-48c4-b18f-c4dd4c65e35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3', 'volume_size': 1} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:35 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c" returned: 0 in 1.040s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:35 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c Sep 09 03:53:35 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:35 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d" returned: 0 in 0.348s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-711101465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2da39ad-89ed-4224-9c81-bfc14ea85fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:35Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Creating volume f2da39ad-89ed-4224-9c81-bfc14ea85fb0 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:35 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:35 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 1073741824 Sep 09 03:53:35 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad955599-bd89-4429-909d-8b019490f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad73a147-f6d7-486a-b857-ffaf49529d9d', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e200a4-8ee2-4078-aa70-bf9e36cc0468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:35 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume volume-ad73a147-f6d7-486a-b857-ffaf49529d9d (ad73a147-f6d7-486a-b857-ffaf49529d9d): created successfully Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e200a4-8ee2-4078-aa70-bf9e36cc0468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (2c032ebe-e13a-431f-a667-cbcdaf94e465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f10af15b-0353-41c4-9993-c36baabfd387 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created volume successfully. Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (455a8a5f-f125-4bd4-837f-ece8552d25c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:36 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b096f5f0-d6e0-4f88-a975-9d0ba21cf0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1068fc2c-e0bf-403a-b7d9-c695ceee948c" returned: 0 in 0.629s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b096f5f0-d6e0-4f88-a975-9d0ba21cf0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1983529132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985a3096-854f-486a-900e-f5842e02ef63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:36Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81753b9c-e438-46c9-9174-778619c54b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81753b9c-e438-46c9-9174-778619c54b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eacd83e-35a1-4ecb-9f95-65d73bf0f1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eacd83e-35a1-4ecb-9f95-65d73bf0f1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985a3096-854f-486a-900e-f5842e02ef63', 'volume_name': 'volume-985a3096-854f-486a-900e-f5842e02ef63', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cd7d92-3d24-4077-93ef-fef8e4fd59c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cd7d92-3d24-4077-93ef-fef8e4fd59c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f672e2-7ff6-49d6-aa8a-0dbe34e6facb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume 985a3096-854f-486a-900e-f5842e02ef63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985a3096-854f-486a-900e-f5842e02ef63', 'volume_size': 1} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-1068fc2c-e0bf-403a-b7d9-c695ceee948c" released by "delete_volume" :: held 1.920s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created reservations ['421f802f-6c57-48d7-af54-5109ad1109ff', '60233b17-3d3a-4e86-9bfd-037a99c51fd8', '79f3a0b6-82aa-490c-ac31-e4ba9fb43c68', '85c4c3f5-3e4b-44e8-9446-0b83b4f7fec3'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:36 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 1073741824" returned: 0 in 0.834s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (88900087-04e9-47bd-9d96-db3a985624cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881c9a12-506f-4acf-bb6a-c05976c04ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881c9a12-506f-4acf-bb6a-c05976c04ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496177522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91118cc-9002-4691-8c3b-7412963dde1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:37Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75a0709-a2dd-49e2-8723-e91730cf3643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75a0709-a2dd-49e2-8723-e91730cf3643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569fa0df-3f8f-4ce6-bd24-fadf6a3defc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569fa0df-3f8f-4ce6-bd24-fadf6a3defc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91118cc-9002-4691-8c3b-7412963dde1f', 'volume_name': 'volume-e91118cc-9002-4691-8c3b-7412963dde1f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813363ce-d9ca-4950-aaa7-b2bdac956150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813363ce-d9ca-4950-aaa7-b2bdac956150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6eb9e69-61e2-4e3f-b7c0-ddbb60db52f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:36 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume e91118cc-9002-4691-8c3b-7412963dde1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91118cc-9002-4691-8c3b-7412963dde1f', 'volume_size': 1} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:36 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 Sep 09 03:53:36 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:36 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:36 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:37 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0" returned: 0 in 0.414s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1438302782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:35Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Creating volume ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:37 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:37 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.388s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Deleted volume successfully. Sep 09 03:53:37 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 1073741824 Sep 09 03:53:37 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07188e6-eb11-4589-bf49-85d753eeaa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0165e618-e59a-4ad6-b050-f48513e147c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 (f2da39ad-89ed-4224-9c81-bfc14ea85fb0): created successfully Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0165e618-e59a-4ad6-b050-f48513e147c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (8081e014-7993-4973-b71f-eba2eb211551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0d236c03-b564-4190-970c-6275e4f77308 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-1068fc2c-e0bf-403a-b7d9-c695ceee948c-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-96ac6523-6783-413d-887a-2ff890c9b639 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created volume successfully. Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:37 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:37 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-quobyte-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[927e7de6-e900-44b8-af39-22fa12a0d279]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:37 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.391s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:53:37 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 1073741824" returned: 0 in 0.660s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:37 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 Sep 09 03:53:37 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:37 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb Sep 09 03:53:37 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:38 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3" returned: 0 in 0.282s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.696s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1983529132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985a3096-854f-486a-900e-f5842e02ef63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:36Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Creating volume 985a3096-854f-486a-900e-f5842e02ef63 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:38 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:38 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb" returned: 0 in 0.399s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:38 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 1073741824 Sep 09 03:53:38 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472aa541-17f9-48c4-b18f-c4dd4c65e35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:38 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb Sep 09 03:53:38 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9faedf1-b777-459d-ba33-36b05bb395e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 (ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3): created successfully Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9faedf1-b777-459d-ba33-36b05bb395e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (39c0cf6f-a75f-4674-b731-ff52b11ce88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:38 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d759f1a8-296f-477b-a3ae-e7817b863e39 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created volume successfully. Sep 09 03:53:38 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb" returned: 0 in 0.324s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb" released by "delete_volume" :: held 0.773s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created reservations ['4c224905-5838-437f-aaf9-23f00050b129', '6fa7e4ed-5df3-46f9-8198-ec1ef0040852', 'd7eab4d3-d56d-44ed-beb5-10a3d68c8a6f', '96172640-c779-4ce1-be36-2bf064b095c9'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:38 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 1073741824" returned: 0 in 0.545s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:38 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:38 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:38 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 Sep 09 03:53:38 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-9120a574-7514-4dca-a0c0-bf862f94e3fc-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-9120a574-7514-4dca-a0c0-bf862f94e3fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-quobyte-9120a574-7514-4dca-a0c0-bf862f94e3fc" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-9120a574-7514-4dca-a0c0-bf862f94e3fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d476e64b-fbdf-4012-93f8-6751d701bc46]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:39 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.338s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Deleted volume successfully. Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e72b8704-8365-43cd-bad2-bfaa99961098 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-9494c5dd-d48b-4ce4-bcf9-b6c4396dd6cb-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:39 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63" returned: 0 in 0.356s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.396s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496177522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91118cc-9002-4691-8c3b-7412963dde1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc53dc617964d14a5f0033c4dc7dff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:37Z,use_quota=True,user_id='04cc1dd024d14787b0ae1c7cf332d804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Creating volume e91118cc-9002-4691-8c3b-7412963dde1f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:39 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:39 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f672e2-7ff6-49d6-aa8a-0dbe34e6facb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985a3096-854f-486a-900e-f5842e02ef63', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:39 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951e4d8f-c269-41c7-be20-c33615f69aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:39 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f 1073741824 Sep 09 03:53:39 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume volume-985a3096-854f-486a-900e-f5842e02ef63 (985a3096-854f-486a-900e-f5842e02ef63): created successfully Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951e4d8f-c269-41c7-be20-c33615f69aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (455a8a5f-f125-4bd4-837f-ece8552d25c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8e37feab-18ba-4c6d-adbd-89abcbd36fd9 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created volume successfully. Sep 09 03:53:39 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc" returned: 0 in 0.472s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:39 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc Sep 09 03:53:39 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:39 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f 1073741824" returned: 0 in 0.599s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:39 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9120a574-7514-4dca-a0c0-bf862f94e3fc" returned: 0 in 0.316s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:39 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f Sep 09 03:53:39 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-9120a574-7514-4dca-a0c0-bf862f94e3fc" released by "delete_volume" :: held 0.849s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Created reservations ['ba54b2d0-f8a5-4ec9-a370-ca52a6cf2270', '33bd20d4-4670-490a-83db-06d86122d6bc', '85388aa6-6908-4677-828c-81c1ad601df5', 'bac745a2-2555-40c1-9f1b-1944ffb66603'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:40 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:40 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-346d7fbe-ff8d-4d79-9fb2-9563e69eff07-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-346d7fbe-ff8d-4d79-9fb2-9563e69eff07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-quobyte-57bdba00-6a34-4723-9fae-a72bf85ef86e" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-57bdba00-6a34-4723-9fae-a72bf85ef86e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-quobyte-346d7fbe-ff8d-4d79-9fb2-9563e69eff07" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:40 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f" returned: 0 in 0.450s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-346d7fbe-ff8d-4d79-9fb2-9563e69eff07" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Deleting offline snapshot 346d7fbe-ff8d-4d79-9fb2-9563e69eff07 of volume 57bdba00-6a34-4723-9fae-a72bf85ef86e {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] snapshot_file for this snap is: volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6eb9e69-61e2-4e3f-b7c0-ddbb60db52f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91118cc-9002-4691-8c3b-7412963dde1f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ff0703-1615-45d2-84da-160ee3e5adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f15f3-77c2-4427-9495-b99f006593d5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:40 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Volume volume-e91118cc-9002-4691-8c3b-7412963dde1f (e91118cc-9002-4691-8c3b-7412963dde1f): created successfully Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ff0703-1615-45d2-84da-160ee3e5adc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Flow 'volume_create_manager' (88900087-04e9-47bd-9d96-db3a985624cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:40 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f097d416-9ce4-47d7-ae2b-dbfd61857b3f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created volume successfully. Sep 09 03:53:40 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.446s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:40 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Deleted volume successfully. Sep 09 03:53:40 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 Sep 09 03:53:40 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-981b23d1-c762-44a0-b19f-8dd432efe58c tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-9120a574-7514-4dca-a0c0-bf862f94e3fc-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:40 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07" returned: 0 in 0.450s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57bdba00-6a34-4723-9fae-a72bf85ef86e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e79ea2-a764-45fc-a27f-b2bc4efe07b2]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:40 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e Sep 09 03:53:40 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:41 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e" returned: 0 in 0.463s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-e91118cc-9002-4691-8c3b-7412963dde1f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:41 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 Sep 09 03:53:41 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-e91118cc-9002-4691-8c3b-7412963dde1f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-quobyte-e91118cc-9002-4691-8c3b-7412963dde1f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-e91118cc-9002-4691-8c3b-7412963dde1f" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df27ba-d43b-4988-ad0c-95f1e5752e7a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:41 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f Sep 09 03:53:41 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:41 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07" returned: 0 in 0.655s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:41 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07 Sep 09 03:53:41 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:41 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f" returned: 0 in 0.516s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:42 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f Sep 09 03:53:42 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:42 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e.346d7fbe-ff8d-4d79-9fb2-9563e69eff07" returned: 0 in 0.297s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-346d7fbe-ff8d-4d79-9fb2-9563e69eff07" released by "_delete_snapshot" :: held 2.014s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-57bdba00-6a34-4723-9fae-a72bf85ef86e" released by "delete_snapshot" :: held 2.051s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:42 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e91118cc-9002-4691-8c3b-7412963dde1f" returned: 0 in 0.438s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Created reservations ['ecdefb99-da11-47ff-900b-a8d95f0783ba', 'a5adbf3f-42d1-4b3b-9245-3489c528de96', 'b855eb5e-5218-4dfe-ad13-a20ef5db3198', '66931d7c-4b5d-4f0b-b7e6-300cd365020a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-e91118cc-9002-4691-8c3b-7412963dde1f" released by "delete_volume" :: held 1.033s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Delete snapshot completed successfully. Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created reservations ['eb0efcdb-4016-4b61-a9e6-f4633809f8b1', '55e51819-6d8a-4065-8a3d-107a5c65a574', '9ddd2cdd-03fa-42ed-87af-504301399321', '74414ce4-7742-40f7-a007-c328b649fc5b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2dbc8701-6215-4a5d-b022-408da33a07fd tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-346d7fbe-ff8d-4d79-9fb2-9563e69eff07-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:42 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:42 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:43 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.346s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Deleted volume successfully. Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-07e493f7-9107-4663-a56a-835654180112 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-e91118cc-9002-4691-8c3b-7412963dde1f-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-57bdba00-6a34-4723-9fae-a72bf85ef86e-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-57bdba00-6a34-4723-9fae-a72bf85ef86e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "cinder-quobyte-57bdba00-6a34-4723-9fae-a72bf85ef86e" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-57bdba00-6a34-4723-9fae-a72bf85ef86e" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2404c4f7-b919-4797-b0ee-961a50395473]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-985a3096-854f-486a-900e-f5842e02ef63-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-985a3096-854f-486a-900e-f5842e02ef63-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=159,cinder:INSERT=51,cinder:UPDATE=197,cinder:DELETE=22 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-quobyte-985a3096-854f-486a-900e-f5842e02ef63" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-985a3096-854f-486a-900e-f5842e02ef63" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:43 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e Sep 09 03:53:43 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[812cf65f-958b-4883-a1f0-0fd84a0aa939]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:43 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 Sep 09 03:53:43 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:44 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e" returned: 0 in 0.484s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:44 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e Sep 09 03:53:44 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:44 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63" returned: 0 in 0.458s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:44 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63 Sep 09 03:53:44 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:44 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57bdba00-6a34-4723-9fae-a72bf85ef86e" returned: 0 in 0.318s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-quobyte-57bdba00-6a34-4723-9fae-a72bf85ef86e" released by "delete_volume" :: held 0.888s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Created reservations ['7be2ae8d-aa9f-4d9d-b6e1-3c445c5662a4', '1e400f29-6adf-4641-9de1-18791bf4dd4e', 'df9e33c9-8f49-4380-b86f-cc70c9fd4da7', '2ec55519-dbd5-4c50-8495-97566ed37c6b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:44 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-985a3096-854f-486a-900e-f5842e02ef63" returned: 0 in 0.496s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:44 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:44 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-985a3096-854f-486a-900e-f5842e02ef63" released by "delete_volume" :: held 1.040s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created reservations ['6cab9de9-1345-458a-b010-b124a8885a17', 'abfd677b-ea8c-411a-a89f-dbd132bf837b', '41f22b65-0c72-4d0b-aeaa-bb96174d4034', '0b1cd60c-5694-46cc-b110-b2bc349bf4a6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:45 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:45 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:45 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.496s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:45 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Deleted volume successfully. Sep 09 03:53:45 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-df05d111-5c3d-4ab5-9ace-f64fe8383792 tempest-CreateVolumesFromSnapshotTest-644101158 None] Lock "cinder-57bdba00-6a34-4723-9fae-a72bf85ef86e-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:45 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.337s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:45 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Deleted volume successfully. Sep 09 03:53:45 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-265c77e7-79c9-4f75-a2d5-fa4086d25daf tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-985a3096-854f-486a-900e-f5842e02ef63-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=229,cinder:SELECT=169,cinder:INSERT=48,cinder:DELETE=16 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-quobyte-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f18a55b-0017-4b98-91e6-32ffd9bf0745]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:46 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 Sep 09 03:53:46 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:46 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3" returned: 0 in 0.441s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:46 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3 Sep 09 03:53:46 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:46 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3" returned: 0 in 0.310s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3" released by "delete_volume" :: held 0.811s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created reservations ['f88f5dc4-27bc-435b-a179-3a0ca8b013bd', '9fbb2d11-bd64-4236-826c-32907045b351', '9ee29d92-96f8-40f9-ba56-377c88015fde', 'fab9c26e-7b11-48f6-a7ab-c20f1871c620'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:47 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:47 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-f2da39ad-89ed-4224-9c81-bfc14ea85fb0-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-f2da39ad-89ed-4224-9c81-bfc14ea85fb0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-quobyte-f2da39ad-89ed-4224-9c81-bfc14ea85fb0" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-f2da39ad-89ed-4224-9c81-bfc14ea85fb0" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[68650e84-64c3-4ba6-aa6a-30f5543cf3f3]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:47 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.431s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:47 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Deleted volume successfully. Sep 09 03:53:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1e1b660b-e66d-4617-82d6-28340a137e9f tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-ba8bac46-4ae9-47fc-a3c5-fbf839c43ff3-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:47 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 Sep 09 03:53:47 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:48 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0" returned: 0 in 0.625s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:48 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0 Sep 09 03:53:48 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-47e3ad30-57d0-48af-a1e4-9b0ae5a10dd1 req-533e8fd6-e63c-4bd7-ab8b-f0793de92fed tempest-TestMinimumBasicScenario-561332143 None] Terminate volume connection completed successfully. Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-47e3ad30-57d0-48af-a1e4-9b0ae5a10dd1 req-533e8fd6-e63c-4bd7-ab8b-f0793de92fed tempest-TestMinimumBasicScenario-561332143 None] Deleting attachment 8898bd58-0e27-415d-985a-63857a20b94c. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:53:48 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f2da39ad-89ed-4224-9c81-bfc14ea85fb0" returned: 0 in 0.528s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-f2da39ad-89ed-4224-9c81-bfc14ea85fb0" released by "delete_volume" :: held 1.207s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created reservations ['53e23aa8-6a54-4062-b387-f94955d8261d', '68ba818e-1db4-4259-ac0b-9ce26dc70523', '581f3d60-5b4c-494a-a3e1-0ba991be2aaa', '9b65382c-6bef-40bf-9023-b08f5b8fb7c1'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:49 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:49 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Acquiring lock "cinder-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Lock "cinder-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Acquiring lock "cinder-quobyte-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Lock "cinder-quobyte-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2dcd9b-a6da-4bdf-a75e-b5b2c275bcb4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:49 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.553s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Deleted volume successfully. Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9dfd06d8-ec3b-4a1e-bb8d-354e6c816f56 tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-f2da39ad-89ed-4224-9c81-bfc14ea85fb0-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:49 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 Sep 09 03:53:49 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-ad73a147-f6d7-486a-b857-ffaf49529d9d-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-ad73a147-f6d7-486a-b857-ffaf49529d9d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-quobyte-ad73a147-f6d7-486a-b857-ffaf49529d9d" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-ad73a147-f6d7-486a-b857-ffaf49529d9d" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[28140546-38e8-46d6-be3a-902b8bf65ba7]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:50 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d Sep 09 03:53:50 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:50 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851" returned: 0 in 0.610s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:50 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851 Sep 09 03:53:50 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:50 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d" returned: 0 in 0.473s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:50 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d Sep 09 03:53:50 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:50 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851" returned: 0 in 0.423s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Lock "cinder-quobyte-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851" released by "delete_volume" :: held 1.112s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Created reservations ['03912edd-08bc-4750-96ec-73fc04e136b7', 'a36922b6-1fcc-4ef5-b435-e841b2b27c96', '29ee7acf-1e75-4d93-8dd2-848ca2a5d36c', '0efc9aa0-fda0-4080-8529-a9a4a343fb0f'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:50 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:50 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:50 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Flow 'volume_create_manager' (73e1f1b8-d53e-4e5e-8a6b-85b42470b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d1754e-3dea-43c0-b64a-321728d4a2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ad73a147-f6d7-486a-b857-ffaf49529d9d" returned: 0 in 0.436s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d1754e-3dea-43c0-b64a-321728d4a2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e434653620514170a393f1f389eb76cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:51Z,use_quota=True,user_id='4c9c494469314f609c258d08cc71a85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718f5e27-7792-429a-a605-8941b2e7dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718f5e27-7792-429a-a605-8941b2e7dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48ea2c9-7744-4437-87f1-c9eba0f3cfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48ea2c9-7744-4437-87f1-c9eba0f3cfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a', 'volume_name': 'volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944f47a1-289d-4573-89ac-ac6a00c7076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944f47a1-289d-4573-89ac-ac6a00c7076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7979b8b-4c0d-45af-b9b8-3387d1480569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:50 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Volume 8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a', 'volume_size': 1} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e434653620514170a393f1f389eb76cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:51Z,use_quota=True,user_id='4c9c494469314f609c258d08cc71a85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Creating volume 8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:50 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-ad73a147-f6d7-486a-b857-ffaf49529d9d" released by "delete_volume" :: held 1.054s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:50 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a 1073741824 Sep 09 03:53:50 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created reservations ['e82b3dd8-72c2-467b-9ff4-47ccfed492b6', '9ba7b18e-2469-479e-bbbb-25351e6e7362', '0935bbe8-48b4-4624-aa31-62f191601f94', 'd7c315d9-f83d-4bc4-8da8-a9bfdaa6576e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:51 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.330s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Deleted volume successfully. Sep 09 03:53:51 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:51 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-af7e575f-f4e9-4701-b31e-63e0c51d8a2f tempest-TestMinimumBasicScenario-561332143 None] Lock "cinder-c5d300a3-4a0f-4fc6-b210-11e5f7dfc851-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:51 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.296s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:51 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Deleted volume successfully. Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a 1073741824" returned: 0 in 0.497s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea4bf911-2016-48c5-87b7-120a7bdb6fbb tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-ad73a147-f6d7-486a-b857-ffaf49529d9d-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:51 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a Sep 09 03:53:51 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:51 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a" returned: 0 in 0.382s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7979b8b-4c0d-45af-b9b8-3387d1480569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7957424-63d0-4670-b242-4bed66ba93a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:51 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Volume volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a (8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a): created successfully Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7957424-63d0-4670-b242-4bed66ba93a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Flow 'volume_create_manager' (73e1f1b8-d53e-4e5e-8a6b-85b42470b17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-383ed42a-3a85-4719-9e3f-1b5dc64771b7 tempest-CinderUnicodeTest-1551077414 None] Created volume successfully. Sep 09 03:53:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-167483b3-e158-4c21-b849-2e755e1a401f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-167483b3-e158-4c21-b849-2e755e1a401f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "cinder-quobyte-167483b3-e158-4c21-b849-2e755e1a401f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-167483b3-e158-4c21-b849-2e755e1a401f" acquired by "delete_volume" :: waited 0.049s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:52 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d18eb89-edda-42ea-9562-a1f5d97e7a64]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:52 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f Sep 09 03:53:52 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:52 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f" returned: 0 in 0.676s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:53 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f Sep 09 03:53:53 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:53 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-167483b3-e158-4c21-b849-2e755e1a401f" returned: 0 in 0.505s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-quobyte-167483b3-e158-4c21-b849-2e755e1a401f" released by "delete_volume" :: held 1.299s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Created reservations ['6fc0e2a1-283a-4b91-bfe5-82a037e3332c', 'a214ddf4-af8e-4e73-b433-79219c689073', 'fe679777-d3c4-402b-ae5c-63d56e18045f', '415eb7a5-673d-490c-b14b-075629e9cd49'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Flow 'volume_create_manager' (f029dcb0-de8f-49a8-9ef6-e84b72b050b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534058b7-0c4a-4ef4-85ab-0864d778f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534058b7-0c4a-4ef4-85ab-0864d778f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-591340523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2473f43b-acb0-453b-ad97-6183178d763a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e434653620514170a393f1f389eb76cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:54Z,use_quota=True,user_id='4c9c494469314f609c258d08cc71a85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4d4adc-561a-43be-ba0b-10ebe5e63fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4d4adc-561a-43be-ba0b-10ebe5e63fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d46bc58-1429-457d-b0be-fc0348b5a627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d46bc58-1429-457d-b0be-fc0348b5a627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2473f43b-acb0-453b-ad97-6183178d763a', 'volume_name': 'volume-2473f43b-acb0-453b-ad97-6183178d763a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22f3d47-8c62-4060-a0de-6a872611e575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22f3d47-8c62-4060-a0de-6a872611e575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9c37b8-afea-4738-953a-cc9b73789d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:53 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Volume 2473f43b-acb0-453b-ad97-6183178d763a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2473f43b-acb0-453b-ad97-6183178d763a', 'volume_size': 1} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-591340523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2473f43b-acb0-453b-ad97-6183178d763a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e434653620514170a393f1f389eb76cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:54Z,use_quota=True,user_id='4c9c494469314f609c258d08cc71a85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Creating volume 2473f43b-acb0-453b-ad97-6183178d763a {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:53 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:53 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a 1073741824 Sep 09 03:53:53 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:53 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:53:53 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:54 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.386s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:54 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:53:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Deleted volume successfully. Sep 09 03:53:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fef8967b-d769-4eeb-9fdf-9212f21d236e tempest-CreateVolumesFromSourceVolumeTest-190420022 None] Lock "cinder-167483b3-e158-4c21-b849-2e755e1a401f-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:53:54 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a 1073741824" returned: 0 in 0.688s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:54 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a Sep 09 03:53:54 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:55 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a" returned: 0 in 0.450s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9c37b8-afea-4738-953a-cc9b73789d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2473f43b-acb0-453b-ad97-6183178d763a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128b58be-af6d-409e-b00a-50761b42803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:55 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Volume volume-2473f43b-acb0-453b-ad97-6183178d763a (2473f43b-acb0-453b-ad97-6183178d763a): created successfully Sep 09 03:53:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128b58be-af6d-409e-b00a-50761b42803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Flow 'volume_create_manager' (f029dcb0-de8f-49a8-9ef6-e84b72b050b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:55 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b72cfbdf-33b3-49e2-80df-c934adb3377b tempest-CinderUnicodeTest-1551077414 None] Created volume successfully. Sep 09 03:53:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Creating offline snapshot 209d2c6a-3743-493e-be19-51ab47310d49 of volume 2473f43b-acb0-453b-ad97-6183178d763a {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:53:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[98485f1c-b04b-4bd8-a116-f487e93020ed]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:56 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a Sep 09 03:53:56 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:56 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a" returned: 0 in 0.443s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:56 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 1G Sep 09 03:53:56 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:57 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 1G" returned: 0 in 0.532s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2473f43b-acb0-453b-ad97-6183178d763a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:57 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2473f43b-acb0-453b-ad97-6183178d763a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 Sep 09 03:53:57 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:57 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2473f43b-acb0-453b-ad97-6183178d763a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49" returned: 0 in 0.402s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:57 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 is being set with open permissions: ugo+rw Sep 09 03:53:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:57 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 Sep 09 03:53:57 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:57 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49" returned: 0 in 0.305s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:57 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.info Sep 09 03:53:57 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:58 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.info" returned: 0 in 0.299s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:58 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.info is being set with open permissions: ugo+rw Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:58 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.info Sep 09 03:53:58 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Flow 'volume_create_manager' (15b39a33-763d-4be5-aeeb-8990cb377639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85649961-3bef-4563-ae8d-f0b9967f1606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85649961-3bef-4563-ae8d-f0b9967f1606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1917427670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c5ddba-dc79-43cf-9410-c87fcfb5bab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564311fbfb314d4dae725620c925646b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:58Z,use_quota=True,user_id='7fc1313cc6314b97a9b6fdcb72dd691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8872dae6-0cdf-4a52-ba8c-c34a23c44f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8872dae6-0cdf-4a52-ba8c-c34a23c44f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1b9111-7aac-48ba-95d7-6c316521b111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1b9111-7aac-48ba-95d7-6c316521b111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c5ddba-dc79-43cf-9410-c87fcfb5bab5', 'volume_name': 'volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad0e959-543f-44f9-a59d-2698ca770112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad0e959-543f-44f9-a59d-2698ca770112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca38e0b-2554-4e25-8005-9f25cbeb283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Volume c8c5ddba-dc79-43cf-9410-c87fcfb5bab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5', 'volume_size': 1} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:58 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.info" returned: 0 in 0.403s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.190s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1917427670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c5ddba-dc79-43cf-9410-c87fcfb5bab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564311fbfb314d4dae725620c925646b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:58Z,use_quota=True,user_id='7fc1313cc6314b97a9b6fdcb72dd691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Creating volume c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:53:58 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:53:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:58 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 1073741824 Sep 09 03:53:58 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:58 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e7db40d2-5850-4e88-ad4c-af6df0cd2de7 tempest-CinderUnicodeTest-1551077414 None] Create snapshot completed successfully Sep 09 03:53:59 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 1073741824" returned: 0 in 0.497s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:59 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 Sep 09 03:53:59 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Flow 'volume_create_manager' (0e428f99-d9e2-43e0-b915-abac8203ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049bf417-4ef1-466e-83d2-5b091f1057a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049bf417-4ef1-466e-83d2-5b091f1057a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-38913992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315c8188-cb25-4e0b-ade5-8daaa774cca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6742535c0c943d7ac881438ba885d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:59Z,use_quota=True,user_id='adfac202c01945138d03861382d1278d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb0fdbf-a121-4612-833d-4ca60573beb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb0fdbf-a121-4612-833d-4ca60573beb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23bf932-a7fb-4b4c-bd17-3c4981fb49cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "cinder-209d2c6a-3743-493e-be19-51ab47310d49-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-209d2c6a-3743-493e-be19-51ab47310d49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "cinder-quobyte-2473f43b-acb0-453b-ad97-6183178d763a" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-quobyte-2473f43b-acb0-453b-ad97-6183178d763a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "cinder-quobyte-209d2c6a-3743-493e-be19-51ab47310d49" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-quobyte-209d2c6a-3743-493e-be19-51ab47310d49" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Deleting offline snapshot 209d2c6a-3743-493e-be19-51ab47310d49 of volume 2473f43b-acb0-453b-ad97-6183178d763a {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] snapshot_file for this snap is: volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9443dd53-1d3d-4cfd-ad85-8fb94c4b91ea]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:53:59 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" returned: 0 in 0.391s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca38e0b-2554-4e25-8005-9f25cbeb283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de28b265-2d00-4573-b092-eec107bfcc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:59 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Volume volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 (c8c5ddba-dc79-43cf-9410-c87fcfb5bab5): created successfully Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de28b265-2d00-4573-b092-eec107bfcc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Flow 'volume_create_manager' (15b39a33-763d-4be5-aeeb-8990cb377639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:53:59 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 Sep 09 03:53:59 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:53:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e94b67c5-6607-438c-a896-ffce3fa5d715 tempest-VolumeDependencyTests-1083810030 None] Created volume successfully. Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23bf932-a7fb-4b4c-bd17-3c4981fb49cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '315c8188-cb25-4e0b-ade5-8daaa774cca0', 'volume_name': 'volume-315c8188-cb25-4e0b-ade5-8daaa774cca0', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c57721c-dd43-4a72-91fd-d019ff770f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c57721c-dd43-4a72-91fd-d019ff770f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25427267-0896-40d9-bc1f-d852711bd77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:53:59 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Volume 315c8188-cb25-4e0b-ade5-8daaa774cca0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-315c8188-cb25-4e0b-ade5-8daaa774cca0', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Trying to clone 315c8188-cb25-4e0b-ade5-8daaa774cca0 from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f at location (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:53:59 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49" returned: 0 in 0.411s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2473f43b-acb0-453b-ad97-6183178d763a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f7ddd-c218-441a-9861-03bac6611e7d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:53:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:00 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a Sep 09 03:54:00 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:54:00 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Image download 20.69 MB at 20.69 MB/s Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d731d798-5c0b-4621-922a-6228c789b489]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:00 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD Sep 09 03:54:00 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:00 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a" returned: 0 in 0.475s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:00 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 Sep 09 03:54:00 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Creating offline snapshot b3652c59-6788-49b9-bffb-3d634bbbef9a of volume c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e17b71b-b287-41bc-bf4a-8645c2d5cd6a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:00 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f is fetched for user adfac202c01945138d03861382d1278d. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:54:00 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 Sep 09 03:54:00 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[813fae8e-4e3e-4855-8bd2-2d4c6921e283]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:00 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49" returned: 0 in 0.428s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:00 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49 Sep 09 03:54:00 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:00 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD Sep 09 03:54:00 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:00 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" returned: 0 in 0.378s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:00 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a 1G Sep 09 03:54:00 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:01 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:01 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a.209d2c6a-3743-493e-be19-51ab47310d49" returned: 0 in 0.266s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-quobyte-209d2c6a-3743-493e-be19-51ab47310d49" released by "_delete_snapshot" :: held 1.710s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-quobyte-2473f43b-acb0-453b-ad97-6183178d763a" released by "delete_snapshot" :: held 1.736s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Created reservations ['3b129b2b-d196-4346-a819-996b2475baea', 'a15ec030-149f-4915-b032-7bb0bafe4b9f', 'b01fafe2-8cd1-44d6-8539-1e4418f72264', '8434cd7b-767a-4c56-8f3a-977d11d916f5'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:54:01 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Delete snapshot completed successfully. Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a2077cbf-2a9e-4a8b-a35c-33fc98a28ba1 tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-209d2c6a-3743-493e-be19-51ab47310d49-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:01 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a 1G" returned: 0 in 0.530s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:01 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a Sep 09 03:54:01 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "cinder-2473f43b-acb0-453b-ad97-6183178d763a-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-2473f43b-acb0-453b-ad97-6183178d763a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "cinder-quobyte-2473f43b-acb0-453b-ad97-6183178d763a" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-quobyte-2473f43b-acb0-453b-ad97-6183178d763a" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf25d11-9c3c-4688-aed8-d22e8cc00cbd]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:01 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a" returned: 0 in 0.334s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:01 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a is being set with open permissions: ugo+rw Sep 09 03:54:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:01 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a Sep 09 03:54:01 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:01 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a Sep 09 03:54:01 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:02 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a" returned: 0 in 0.251s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:02 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.info Sep 09 03:54:02 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:02 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a" returned: 0 in 0.415s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:02 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a Sep 09 03:54:02 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:02 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.info" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:02 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.info is being set with open permissions: ugo+rw Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:02 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.info Sep 09 03:54:02 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:02 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2473f43b-acb0-453b-ad97-6183178d763a" returned: 0 in 0.358s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-quobyte-2473f43b-acb0-453b-ad97-6183178d763a" released by "delete_volume" :: held 0.842s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Created reservations ['c4524da2-9da5-4d1a-b1db-0be30f4bd322', '5fcdb0d0-792d-46e0-a61b-edbc37ef8ce3', '240e93eb-7e8e-42d5-ad3d-ad4c20f8c040', 'fdee7ff7-bb62-4b12-838f-97cfa4f4af9f'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:54:02 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.info" returned: 0 in 0.292s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-38913992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315c8188-cb25-4e0b-ade5-8daaa774cca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6742535c0c943d7ac881438ba885d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:53:59Z,use_quota=True,user_id='adfac202c01945138d03861382d1278d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Creating volume 315c8188-cb25-4e0b-ade5-8daaa774cca0 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:54:02 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "cinder-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:02 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 1073741824 Sep 09 03:54:02 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:02 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:54:02 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:02 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-403ac34e-fdb3-4242-b393-1827b02a1b9a tempest-VolumeDependencyTests-1083810030 None] Create snapshot completed successfully Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "cinder-quobyte-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-quobyte-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a8bdf4-04d0-485f-8591-85ccba6e3573]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:03 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:03 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a Sep 09 03:54:03 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.282s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:54:03 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Deleted volume successfully. Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47e3fed4-0034-4007-9121-9aaa0e9d02fc tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-2473f43b-acb0-453b-ad97-6183178d763a-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:03 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 1073741824" returned: 0 in 0.573s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:03 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:03 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 Sep 09 03:54:03 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a" returned: 0 in 0.466s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:03 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a Sep 09 03:54:03 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:03 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0" returned: 0 in 0.304s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Attempting download of 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume 315c8188-cb25-4e0b-ade5-8daaa774cca0. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:54:03 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a" returned: 0 in 0.310s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-quobyte-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a" released by "delete_volume" :: held 0.829s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2f2080-fabf-46c8-bd08-f68f78e67242]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_wj7aym8u {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Created reservations ['280eaa38-ebc0-4695-8568-f0219adfbb8d', '80a8b2e0-1418-46b4-9db1-14c4a0c299a7', '245a62eb-ef7e-4456-b484-1a4023d842d0', '2614a443-331a-497b-b3aa-355de40ca529'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:04 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:54:04 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:04 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_wj7aym8u Sep 09 03:54:04 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:04 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_wj7aym8u" returned: 0 in 0.457s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_wj7aym8u {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:04 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.465s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:54:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Deleted volume successfully. Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Flow 'volume_create_manager' (54530666-c16a-4dad-920a-137032a713aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4019e13a-40e1-4074-9e10-79dd71bb5ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:04 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_wj7aym8u Sep 09 03:54:04 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ce137827-bac8-4f5e-85ff-cd841b203ceb tempest-CinderUnicodeTest-1551077414 None] Lock "cinder-8fe6dc6f-e970-4ee3-96f7-ea2b28c70e5a-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4019e13a-40e1-4074-9e10-79dd71bb5ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-188647669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fea533a-aa4e-4d71-a7b5-3cef454904b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564311fbfb314d4dae725620c925646b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3652c59-6788-49b9-bffb-3d634bbbef9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:04Z,use_quota=True,user_id='7fc1313cc6314b97a9b6fdcb72dd691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d423eb1-4bb9-4e1d-8b7a-7c0274635ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d423eb1-4bb9-4e1d-8b7a-7c0274635ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc90c4aa-16db-4eec-a020-c47ef0f783d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc90c4aa-16db-4eec-a020-c47ef0f783d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9fea533a-aa4e-4d71-a7b5-3cef454904b0', 'volume_name': 'volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0', 'volume_size': 1, 'snapshot_id': 'b3652c59-6788-49b9-bffb-3d634bbbef9a'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c6c76f-53bd-4071-96cb-2ff7405050a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c6c76f-53bd-4071-96cb-2ff7405050a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f219d0b5-0e1e-4f56-a7a8-bca8a6f138ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:04 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Volume 9fea533a-aa4e-4d71-a7b5-3cef454904b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0', 'volume_size': 1, 'snapshot_id': 'b3652c59-6788-49b9-bffb-3d634bbbef9a'} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-quobyte-b3652c59-6788-49b9-bffb-3d634bbbef9a-9fea533a-aa4e-4d71-a7b5-3cef454904b0" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-b3652c59-6788-49b9-bffb-3d634bbbef9a-9fea533a-aa4e-4d71-a7b5-3cef454904b0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Creating volume 9fea533a-aa4e-4d71-a7b5-3cef454904b0 from snapshot b3652c59-6788-49b9-bffb-3d634bbbef9a {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-quobyte-9fea533a-aa4e-4d71-a7b5-3cef454904b0" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-9fea533a-aa4e-4d71-a7b5-3cef454904b0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] snapshot: b3652c59-6788-49b9-bffb-3d634bbbef9a, volume: 9fea533a-aa4e-4d71-a7b5-3cef454904b0, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c81259-3ee1-4526-89cf-456678058a4c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:04 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_wj7aym8u" returned: 1 in 0.530s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_wj7aym8u' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffbf0e2-ffc8-4d86-af19-8a46b999f9cc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:04 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a Sep 09 03:54:04 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:04 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD Sep 09 03:54:04 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:05 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a" returned: 0 in 0.467s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:54:05 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[883b201a-7eb7-43b2-a443-edf87af3edc7]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f was qcow2, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:05 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 Sep 09 03:54:05 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:05 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 Sep 09 03:54:05 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:05 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" returned: 0 in 0.490s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:54:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:05 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 Sep 09 03:54:05 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:08 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0" returned: 0 in 3.002s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:08 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_278f2cec-6f61-4d0d-82bf-fc92c4a7e72f_y372dm2bdevstack@QuobyteHD, size 112.00 MB, duration 3.01 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:54:08 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Converted 112.00 MB image at 37.19 MB/s Sep 09 03:54:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:08 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 1G Sep 09 03:54:08 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:09 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 1G" returned: 0 in 0.810s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Downloaded image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f ((None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}])) to volume 315c8188-cb25-4e0b-ade5-8daaa774cca0 successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Temporary image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f for user adfac202c01945138d03861382d1278d is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Marking volume 315c8188-cb25-4e0b-ade5-8daaa774cca0 as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Copying metadata from image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f to 315c8188-cb25-4e0b-ade5-8daaa774cca0. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Creating volume glance metadata for volume 315c8188-cb25-4e0b-ade5-8daaa774cca0 backed by image 278f2cec-6f61-4d0d-82bf-fc92c4a7e72f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25427267-0896-40d9-bc1f-d852711bd77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315c8188-cb25-4e0b-ade5-8daaa774cca0', 'volume_size': 1, 'image_id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca674d8092d24bd795b558e3ccdb648e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '278f2cec-6f61-4d0d-82bf-fc92c4a7e72f', 'created_at': datetime.datetime(2026, 9, 9, 1, 33, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 33, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/278f2cec-6f61-4d0d-82bf-fc92c4a7e72f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54d56d5-a76f-4057-9488-3fab7c290eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:09 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Volume volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 (315c8188-cb25-4e0b-ade5-8daaa774cca0): created successfully Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54d56d5-a76f-4057-9488-3fab7c290eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:09 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Flow 'volume_create_manager' (0e428f99-d9e2-43e0-b915-abac8203ddee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:54:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3b47a143-569a-4eb6-970e-b64e2d53772c tempest-TestShelveInstance-38794600 None] Created volume successfully. Sep 09 03:54:11 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0" returned: 0 in 5.555s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:54:11 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Converted 1024.00 MB image at 184.29 MB/s Sep 09 03:54:11 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 is being set with open permissions: ugo+rw Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:11 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 Sep 09 03:54:11 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:11 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0" returned: 0 in 0.266s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-9fea533a-aa4e-4d71-a7b5-3cef454904b0" released by "_copy_volume_from_snapshot" :: held 6.914s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-b3652c59-6788-49b9-bffb-3d634bbbef9a-9fea533a-aa4e-4d71-a7b5-3cef454904b0" released by "_create_volume_from_snapshot" :: held 6.997s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.017s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f219d0b5-0e1e-4f56-a7a8-bca8a6f138ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0', 'volume_size': 1, 'snapshot_id': 'b3652c59-6788-49b9-bffb-3d634bbbef9a'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9bf643-ee96-45d7-b57a-14e5d2f94148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:11 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Volume volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 (9fea533a-aa4e-4d71-a7b5-3cef454904b0): created successfully Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9bf643-ee96-45d7-b57a-14e5d2f94148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:11 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Flow 'volume_create_manager' (54530666-c16a-4dad-920a-137032a713aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:54:11 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9ec43547-8846-49a6-9598-b9a080a859c2 tempest-VolumeDependencyTests-1083810030 None] Created volume successfully. Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-b3652c59-6788-49b9-bffb-3d634bbbef9a-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-b3652c59-6788-49b9-bffb-3d634bbbef9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-quobyte-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-quobyte-b3652c59-6788-49b9-bffb-3d634bbbef9a" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-b3652c59-6788-49b9-bffb-3d634bbbef9a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Deleting offline snapshot b3652c59-6788-49b9-bffb-3d634bbbef9a of volume c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] snapshot_file for this snap is: volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[169aa233-70bd-4dfc-8ff8-06905ce75f04]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:12 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a Sep 09 03:54:12 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:12 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a" returned: 0 in 0.527s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[57260d13-7867-4a60-b755-7c35d40e5eb6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:12 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 Sep 09 03:54:12 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:13 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" returned: 0 in 0.577s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:13 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a Sep 09 03:54:13 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:13 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a" returned: 0 in 0.456s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:13 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a Sep 09 03:54:13 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-696ebbd2-cbd2-414d-8679-10c3a2ce4e8d req-196db4a0-ee60-4fab-945f-299288e2710a tempest-TestShelveInstance-38794600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-696ebbd2-cbd2-414d-8679-10c3a2ce4e8d req-196db4a0-ee60-4fab-945f-299288e2710a tempest-TestShelveInstance-38794600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-696ebbd2-cbd2-414d-8679-10c3a2ce4e8d req-196db4a0-ee60-4fab-945f-299288e2710a tempest-TestShelveInstance-38794600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-696ebbd2-cbd2-414d-8679-10c3a2ce4e8d req-196db4a0-ee60-4fab-945f-299288e2710a tempest-TestShelveInstance-38794600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-315c8188-cb25-4e0b-ade5-8daaa774cca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dc3ad84-1661-4dd7-b46b-f18d034d3cb2', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:54:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-696ebbd2-cbd2-414d-8679-10c3a2ce4e8d req-196db4a0-ee60-4fab-945f-299288e2710a tempest-TestShelveInstance-38794600 None] attachment_update completed successfully. Sep 09 03:54:14 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5.b3652c59-6788-49b9-bffb-3d634bbbef9a" returned: 0 in 0.290s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-b3652c59-6788-49b9-bffb-3d634bbbef9a" released by "_delete_snapshot" :: held 2.006s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" released by "delete_snapshot" :: held 2.050s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Created reservations ['8f390491-a836-4669-b654-54d39ef02b0c', '74bfea77-789c-4722-86d1-3cf55cf26118', 'f0777f5a-b140-4424-90e6-96bcf858849e', 'ca8f6fe6-cd9b-402a-bfc7-ad84778eb434'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:54:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Delete snapshot completed successfully. Sep 09 03:54:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-225b1154-9f8a-4e42-bec8-d16371916f00 tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-b3652c59-6788-49b9-bffb-3d634bbbef9a-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-quobyte-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdaf0f7-920f-40d4-8f30-a2e2c8e4808b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:15 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 Sep 09 03:54:15 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:16 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" returned: 0 in 0.462s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:16 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5 Sep 09 03:54:16 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:16 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" returned: 0 in 0.271s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5" released by "delete_volume" :: held 0.803s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Created reservations ['dbd6892a-5d28-4c42-951e-afaa7dfc106c', 'd0cda4c9-a6f1-4202-b17a-a909aa8950f4', 'd80b96f6-b677-4ffe-848a-a57f49e0acaf', 'b78ddb4f-2b12-485d-a43d-99669587f2fe'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:16 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:54:16 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-9fea533a-aa4e-4d71-a7b5-3cef454904b0-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-9fea533a-aa4e-4d71-a7b5-3cef454904b0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "cinder-quobyte-9fea533a-aa4e-4d71-a7b5-3cef454904b0" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:54:16 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.347s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:54:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Deleted volume successfully. Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-9fea533a-aa4e-4d71-a7b5-3cef454904b0" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-7c0a6081-1574-4626-993c-b36bde90646a tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-c8c5ddba-dc79-43cf-9410-c87fcfb5bab5-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c721701f-ce77-4c29-8227-2fdddbfde7d2]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:54:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:17 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 Sep 09 03:54:17 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:17 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0" returned: 0 in 0.551s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:17 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0 Sep 09 03:54:17 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:17 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9fea533a-aa4e-4d71-a7b5-3cef454904b0" returned: 0 in 0.480s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-quobyte-9fea533a-aa4e-4d71-a7b5-3cef454904b0" released by "delete_volume" :: held 1.135s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Created reservations ['89b46b8b-9e8b-461f-b8e9-0be09c758321', '86f74962-37c8-4a18-8a3c-27a41aff9384', 'b117ba57-bf06-405b-a960-4ee2eab96e32', '96d83daa-8793-4797-abb7-4915201e8300'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:18 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:54:18 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:18 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.303s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:54:18 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Deleted volume successfully. Sep 09 03:54:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-24cc4ccf-8fe5-4632-8dc0-6e16c37b1e8f tempest-VolumeDependencyTests-1083810030 None] Lock "cinder-9fea533a-aa4e-4d71-a7b5-3cef454904b0-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:54:28 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=96,cinder:INSERT=34,cinder:UPDATE=123,cinder:DELETE=8 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:54:28 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=89,cinder:INSERT=35,cinder:UPDATE=99,cinder:DELETE=9 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:37 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:54:37 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:37 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.312s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:54:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:54:40 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Flow 'volume_create_manager' (faabaef3-ab88-4494-a31e-68c9b00dc0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9280c5a1-7773-42b2-a5f5-0c8aa579b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9280c5a1-7773-42b2-a5f5-0c8aa579b757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1283783168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f408a54c2d74b9b94db9f9ecabc05d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:41Z,use_quota=True,user_id='1bdfbe6d737e426aa52fd8a0827963c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e083c1-5003-4f9e-949e-146358b21fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e083c1-5003-4f9e-949e-146358b21fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593f8745-0b17-4825-a59c-b5285452f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593f8745-0b17-4825-a59c-b5285452f54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2', 'volume_name': 'volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae34a205-d3a7-4502-aa11-aa23f418d06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae34a205-d3a7-4502-aa11-aa23f418d06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8787160a-0219-45d0-8071-0882a8158dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:41 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Volume bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2', 'volume_size': 1} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1283783168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f408a54c2d74b9b94db9f9ecabc05d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:54:41Z,use_quota=True,user_id='1bdfbe6d737e426aa52fd8a0827963c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Creating volume bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:54:41 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:41 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 1073741824 Sep 09 03:54:41 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:41 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 1073741824" returned: 0 in 0.463s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:54:41 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 Sep 09 03:54:41 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:54:41 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" returned: 0 in 0.259s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8787160a-0219-45d0-8071-0882a8158dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2d3a8-3fe9-4e95-9557-e1e6cae64e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:54:41 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Volume volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 (bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2): created successfully Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e2d3a8-3fe9-4e95-9557-e1e6cae64e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:54:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Flow 'volume_create_manager' (faabaef3-ab88-4494-a31e-68c9b00dc0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:54:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9254fd1f-505d-4cac-9d12-e274a2cfaa6a tempest-TestStampPattern-2030243761 None] Created volume successfully. Sep 09 03:54:51 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:54:51 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:54:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-1fbdf0df-5372-45a5-bdbd-54d044fb306d req-64bf7114-9126-4478-a117-e8bf1b41f9be tempest-TestShelveInstance-38794600 None] Terminate volume connection completed successfully. Sep 09 03:54:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-1fbdf0df-5372-45a5-bdbd-54d044fb306d req-64bf7114-9126-4478-a117-e8bf1b41f9be tempest-TestShelveInstance-38794600 None] Deleting attachment 7dc3ad84-1661-4dd7-b46b-f18d034d3cb2. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:54:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-edd27604-4d86-4594-b16d-203b86a62fd8 req-4a15781f-664d-44c8-8dc2-fe09dd95635c tempest-TestShelveInstance-38794600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:54:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-edd27604-4d86-4594-b16d-203b86a62fd8 req-4a15781f-664d-44c8-8dc2-fe09dd95635c tempest-TestShelveInstance-38794600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:54:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-edd27604-4d86-4594-b16d-203b86a62fd8 req-4a15781f-664d-44c8-8dc2-fe09dd95635c tempest-TestShelveInstance-38794600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:54:54 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-edd27604-4d86-4594-b16d-203b86a62fd8 req-4a15781f-664d-44c8-8dc2-fe09dd95635c tempest-TestShelveInstance-38794600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-315c8188-cb25-4e0b-ade5-8daaa774cca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ac07096-7c1e-4426-b496-d0e797f41976', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:54:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-edd27604-4d86-4594-b16d-203b86a62fd8 req-4a15781f-664d-44c8-8dc2-fe09dd95635c tempest-TestShelveInstance-38794600 None] attachment_update completed successfully. Sep 09 03:55:04 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=8 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:55:04 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:55:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-587e31ec-1171-4eec-a7f0-057fb525eebd req-8b1673ef-779c-47a7-966e-a14153cdc9b1 tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-587e31ec-1171-4eec-a7f0-057fb525eebd req-8b1673ef-779c-47a7-966e-a14153cdc9b1 tempest-TestStampPattern-2030243761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-587e31ec-1171-4eec-a7f0-057fb525eebd req-8b1673ef-779c-47a7-966e-a14153cdc9b1 tempest-TestStampPattern-2030243761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-587e31ec-1171-4eec-a7f0-057fb525eebd req-8b1673ef-779c-47a7-966e-a14153cdc9b1 tempest-TestStampPattern-2030243761 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0311d026-fec5-4755-b3f8-7b929e8d8ed2', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:55:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-587e31ec-1171-4eec-a7f0-057fb525eebd req-8b1673ef-779c-47a7-966e-a14153cdc9b1 tempest-TestStampPattern-2030243761 None] attachment_update completed successfully. Sep 09 03:55:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-57db5909-cf76-4bf6-ada2-9c0edb2cfaae req-be1e833b-b9d8-4e63-be0c-f513e13c102f tempest-TestStampPattern-2030243761 None] Terminate volume connection completed successfully. Sep 09 03:55:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-57db5909-cf76-4bf6-ada2-9c0edb2cfaae req-be1e833b-b9d8-4e63-be0c-f513e13c102f tempest-TestStampPattern-2030243761 None] Deleting attachment 0311d026-fec5-4755-b3f8-7b929e8d8ed2. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:55:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Creating offline snapshot b231c9f3-a574-4a1a-817b-510c67524efc of volume bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:55:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e3b514-6de4-4c08-9433-e4f11107f734]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:15 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 Sep 09 03:55:15 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:16 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" returned: 0 in 0.363s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:16 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc 1G Sep 09 03:55:16 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:16 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc 1G" returned: 0 in 0.380s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:16 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc Sep 09 03:55:16 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:16 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc" returned: 0 in 0.280s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:16 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc is being set with open permissions: ugo+rw Sep 09 03:55:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:16 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc Sep 09 03:55:16 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:17 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc" returned: 0 in 0.263s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:17 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.info Sep 09 03:55:17 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:17 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.info" returned: 0 in 0.264s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:17 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.info is being set with open permissions: ugo+rw Sep 09 03:55:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:17 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.info Sep 09 03:55:17 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:17 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.info" returned: 0 in 0.256s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5d8103ab-d15c-408c-b3ac-d808e4a31354 tempest-TestStampPattern-2030243761 None] Create snapshot completed successfully Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:55:24 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-394da295-29d8-4d93-9dd3-83c582afff5b req-96020993-91cc-476c-8dd8-81e6144b4f18 tempest-TestShelveInstance-38794600 None] Terminate volume connection completed successfully. Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-394da295-29d8-4d93-9dd3-83c582afff5b req-96020993-91cc-476c-8dd8-81e6144b4f18 tempest-TestShelveInstance-38794600 None] Deleting attachment 1ac07096-7c1e-4426-b496-d0e797f41976. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Flow 'volume_create_manager' (1ca0129b-e272-4d7f-8d0b-d9853b766832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01459676-6ca5-4150-bb4d-46439e436d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01459676-6ca5-4150-bb4d-46439e436d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1064271908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a87d44-b111-4413-8016-39a9ce1ce4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f408a54c2d74b9b94db9f9ecabc05d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b231c9f3-a574-4a1a-817b-510c67524efc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:25Z,use_quota=True,user_id='1bdfbe6d737e426aa52fd8a0827963c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc0ebcf-e2af-43bb-b5a1-f0f22dee8a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc0ebcf-e2af-43bb-b5a1-f0f22dee8a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f636395-2843-47e1-bcd4-f0bca685c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f636395-2843-47e1-bcd4-f0bca685c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35a87d44-b111-4413-8016-39a9ce1ce4ca', 'volume_name': 'volume-35a87d44-b111-4413-8016-39a9ce1ce4ca', 'volume_size': 1, 'snapshot_id': 'b231c9f3-a574-4a1a-817b-510c67524efc'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2637acf2-5635-489d-a91f-36909d2d34e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2637acf2-5635-489d-a91f-36909d2d34e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15e385b-18cc-4e09-ad46-e5df42c560df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:24 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Volume 35a87d44-b111-4413-8016-39a9ce1ce4ca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35a87d44-b111-4413-8016-39a9ce1ce4ca', 'volume_size': 1, 'snapshot_id': 'b231c9f3-a574-4a1a-817b-510c67524efc'} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-quobyte-b231c9f3-a574-4a1a-817b-510c67524efc-35a87d44-b111-4413-8016-39a9ce1ce4ca" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-b231c9f3-a574-4a1a-817b-510c67524efc-35a87d44-b111-4413-8016-39a9ce1ce4ca" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Creating volume 35a87d44-b111-4413-8016-39a9ce1ce4ca from snapshot b231c9f3-a574-4a1a-817b-510c67524efc {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-quobyte-35a87d44-b111-4413-8016-39a9ce1ce4ca" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-35a87d44-b111-4413-8016-39a9ce1ce4ca" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] snapshot: b231c9f3-a574-4a1a-817b-510c67524efc, volume: 35a87d44-b111-4413-8016-39a9ce1ce4ca, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:55:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Acquiring lock "cinder-315c8188-cb25-4e0b-ade5-8daaa774cca0-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Lock "cinder-315c8188-cb25-4e0b-ade5-8daaa774cca0-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e87f41c-d400-41a3-afa3-96796a33ce4f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Acquiring lock "cinder-quobyte-315c8188-cb25-4e0b-ade5-8daaa774cca0" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Lock "cinder-quobyte-315c8188-cb25-4e0b-ade5-8daaa774cca0" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a819c7-8a8f-4bd0-ae10-2ffc646ae88f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:25 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc Sep 09 03:55:25 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:25 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 Sep 09 03:55:25 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:25 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc" returned: 0 in 0.469s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaee7e1b-2f0e-4bb1-bcc1-8d9d24bbcc7f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:25 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0" returned: 0 in 0.472s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:25 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0 Sep 09 03:55:25 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:25 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 Sep 09 03:55:25 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:25 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-315c8188-cb25-4e0b-ade5-8daaa774cca0" returned: 0 in 0.335s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:25 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" returned: 0 in 0.450s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:55:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Lock "cinder-quobyte-315c8188-cb25-4e0b-ade5-8daaa774cca0" released by "delete_volume" :: held 0.898s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:55:26 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca Sep 09 03:55:26 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG cinder.quota [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Created reservations ['8151aaac-074b-4ad9-8b6a-0dbaf02f781f', 'ee009b45-83a3-44ed-a0e7-73eb6e8e36a5', '05037ba8-a9e1-45ff-a43a-c11c91bbc597', 'd2213e36-9684-41ad-98ac-82f6dbc7a9dc'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:26 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:55:26 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:26 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.436s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG cinder.manager [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:55:26 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Deleted volume successfully. Sep 09 03:55:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [req-394da295-29d8-4d93-9dd3-83c582afff5b req-ce8fb830-18ae-46dc-acf5-6f3ed8d5f2d7 tempest-TestShelveInstance-38794600 None] Lock "cinder-315c8188-cb25-4e0b-ade5-8daaa774cca0-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:55:32 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca" returned: 0 in 6.282s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:55:32 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Converted 1024.00 MB image at 162.97 MB/s Sep 09 03:55:32 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca is being set with open permissions: ugo+rw Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:32 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca Sep 09 03:55:32 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:32 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca" returned: 0 in 0.330s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-35a87d44-b111-4413-8016-39a9ce1ce4ca" released by "_copy_volume_from_snapshot" :: held 7.673s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-b231c9f3-a574-4a1a-817b-510c67524efc-35a87d44-b111-4413-8016-39a9ce1ce4ca" released by "_create_volume_from_snapshot" :: held 7.759s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.782s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15e385b-18cc-4e09-ad46-e5df42c560df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a87d44-b111-4413-8016-39a9ce1ce4ca', 'volume_size': 1, 'snapshot_id': 'b231c9f3-a574-4a1a-817b-510c67524efc'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8599385b-2e2d-498f-ad8f-571a74dae217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Volume volume-35a87d44-b111-4413-8016-39a9ce1ce4ca (35a87d44-b111-4413-8016-39a9ce1ce4ca): created successfully Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8599385b-2e2d-498f-ad8f-571a74dae217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Flow 'volume_create_manager' (1ca0129b-e272-4d7f-8d0b-d9853b766832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:55:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cd1aede3-ff16-46e6-93bc-54255d8e7ae4 tempest-TestStampPattern-2030243761 None] Created volume successfully. Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:37 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:55:37 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:37 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.316s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:55:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:55:42 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=21,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:55:42 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=20,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Flow 'volume_create_manager' (d634121e-7645-47c8-ba3a-7ff6b4104dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75726dc5-f71e-4397-9527-beb6b61e894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75726dc5-f71e-4397-9527-beb6b61e894e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c6a4fb-a888-4cd0-9916-7a9603b762f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814acf82729a4d73b6700f5cb50f0bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:47Z,use_quota=True,user_id='78a2e87f0aeb4ad2bd156d0b268d075d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a775feca-f444-453b-8c73-8547f71987c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a775feca-f444-453b-8c73-8547f71987c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69449dc1-fa33-42a3-8553-1412bd381c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69449dc1-fa33-42a3-8553-1412bd381c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37c6a4fb-a888-4cd0-9916-7a9603b762f3', 'volume_name': 'volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3', 'volume_size': 1, 'image_id': '9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22d22cbee6b66d5db621d076c0400ea8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '814acf82729a4d73b6700f5cb50f0bfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3138893c4109e1278eb2be9daa51cfbf9fe0ffa5d59cc160aa0477bc6e9d895f17dbe77280cdd163eaae04e328e22692c2f32a367ce6e2de9297bdb932107cf', 'id': '9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'created_at': datetime.datetime(2026, 9, 9, 1, 55, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf/file', 'properties': {}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5225c9cf-23cf-4565-8a3f-ec426fe8e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5225c9cf-23cf-4565-8a3f-ec426fe8e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c626ad5c-2dae-4581-845c-6182cfa76614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Volume 37c6a4fb-a888-4cd0-9916-7a9603b762f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3', 'volume_size': 1, 'image_id': '9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22d22cbee6b66d5db621d076c0400ea8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '814acf82729a4d73b6700f5cb50f0bfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3138893c4109e1278eb2be9daa51cfbf9fe0ffa5d59cc160aa0477bc6e9d895f17dbe77280cdd163eaae04e328e22692c2f32a367ce6e2de9297bdb932107cf', 'id': '9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'created_at': datetime.datetime(2026, 9, 9, 1, 55, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf/file', 'properties': {}}, 'image_service': } Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Trying to clone 37c6a4fb-a888-4cd0-9916-7a9603b762f3 from image 9f4f7fe8-150f-4eef-a200-6da6fd3fabcf at location (None, [{'url': 'file:///opt/stack/data/glance/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:55:47 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Image download 0.00 MB at 0.00 MB/s Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdb293c-d1ad-4518-a703-c021695d2618]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:47 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD Sep 09 03:55:47 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:48 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:48 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD Sep 09 03:55:48 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:48 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Temporary image 9f4f7fe8-150f-4eef-a200-6da6fd3fabcf is fetched for user 78a2e87f0aeb4ad2bd156d0b268d075d. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe98f33-03e3-4898-bfb9-e3a0d8c97b16]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:48 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD Sep 09 03:55:48 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:48 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:49 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD Sep 09 03:55:49 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:49 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c6a4fb-a888-4cd0-9916-7a9603b762f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814acf82729a4d73b6700f5cb50f0bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:55:47Z,use_quota=True,user_id='78a2e87f0aeb4ad2bd156d0b268d075d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Creating volume 37c6a4fb-a888-4cd0-9916-7a9603b762f3 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:55:49 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:49 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 1073741824 Sep 09 03:55:49 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:49 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 1073741824" returned: 0 in 0.405s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:49 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 Sep 09 03:55:49 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:49 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3" returned: 0 in 0.246s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Attempting download of 9f4f7fe8-150f-4eef-a200-6da6fd3fabcf ((None, [{'url': 'file:///opt/stack/data/glance/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'metadata': {}}])) to volume 37c6a4fb-a888-4cd0-9916-7a9603b762f3. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32bbd6-921f-45b0-901c-a1c587615b84]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_6kvezbvk {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:50 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_6kvezbvk Sep 09 03:55:50 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:50 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_6kvezbvk" returned: 0 in 0.316s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_6kvezbvk {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:50 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_6kvezbvk Sep 09 03:55:50 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:50 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_6kvezbvk" returned: 1 in 0.313s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_6kvezbvk' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:55:50 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f33c7-68b5-4feb-a747-228b3e82982e]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:50 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD Sep 09 03:55:50 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:50 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:51 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD Sep 09 03:55:51 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:51 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:55:51 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] 9f4f7fe8-150f-4eef-a200-6da6fd3fabcf was raw, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:55:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:51 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 Sep 09 03:55:51 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:51 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3" returned: 0 in 0.437s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:51 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9f4f7fe8-150f-4eef-a200-6da6fd3fabcf_7um40f0tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:55:51 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 03:55:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:51 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 1G Sep 09 03:55:51 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:52 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 1G" returned: 0 in 0.323s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Downloaded image 9f4f7fe8-150f-4eef-a200-6da6fd3fabcf ((None, [{'url': 'file:///opt/stack/data/glance/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'metadata': {}}])) to volume 37c6a4fb-a888-4cd0-9916-7a9603b762f3 successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Temporary image 9f4f7fe8-150f-4eef-a200-6da6fd3fabcf for user 78a2e87f0aeb4ad2bd156d0b268d075d is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Marking volume 37c6a4fb-a888-4cd0-9916-7a9603b762f3 as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Copying metadata from image 9f4f7fe8-150f-4eef-a200-6da6fd3fabcf to 37c6a4fb-a888-4cd0-9916-7a9603b762f3. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Creating volume glance metadata for volume 37c6a4fb-a888-4cd0-9916-7a9603b762f3 backed by image 9f4f7fe8-150f-4eef-a200-6da6fd3fabcf with: {'image_id': '9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '22d22cbee6b66d5db621d076c0400ea8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c626ad5c-2dae-4581-845c-6182cfa76614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3', 'volume_size': 1, 'image_id': '9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22d22cbee6b66d5db621d076c0400ea8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '814acf82729a4d73b6700f5cb50f0bfd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e3138893c4109e1278eb2be9daa51cfbf9fe0ffa5d59cc160aa0477bc6e9d895f17dbe77280cdd163eaae04e328e22692c2f32a367ce6e2de9297bdb932107cf', 'id': '9f4f7fe8-150f-4eef-a200-6da6fd3fabcf', 'created_at': datetime.datetime(2026, 9, 9, 1, 55, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f4f7fe8-150f-4eef-a200-6da6fd3fabcf/file', 'properties': {}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8731c726-d34b-484f-806d-1cb38c8375cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:55:52 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Volume volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 (37c6a4fb-a888-4cd0-9916-7a9603b762f3): created successfully Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8731c726-d34b-484f-806d-1cb38c8375cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Flow 'volume_create_manager' (d634121e-7645-47c8-ba3a-7ff6b4104dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:55:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-093d8169-8835-4cfe-8aa1-466eef97ea44 tempest-VolumeImageDependencyTests-654861642 None] Created volume successfully. Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Acquiring lock "cinder-37c6a4fb-a888-4cd0-9916-7a9603b762f3-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Lock "cinder-37c6a4fb-a888-4cd0-9916-7a9603b762f3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Acquiring lock "cinder-quobyte-37c6a4fb-a888-4cd0-9916-7a9603b762f3" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Lock "cinder-quobyte-37c6a4fb-a888-4cd0-9916-7a9603b762f3" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1a1a1a-d198-44ab-aef9-cee311be0847]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:55:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:52 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 Sep 09 03:55:52 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:53 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3" returned: 0 in 0.377s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:53 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3 Sep 09 03:55:53 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:53 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-37c6a4fb-a888-4cd0-9916-7a9603b762f3" returned: 0 in 0.238s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Lock "cinder-quobyte-37c6a4fb-a888-4cd0-9916-7a9603b762f3" released by "delete_volume" :: held 0.654s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Created reservations ['e2e5ce4d-e504-44a6-b2a4-83fa125241a1', 'b8f67c38-0196-4d86-a8cf-3f5f2479f3f9', 'a0f8bacb-87a8-4bd4-80d7-9ec18903e2b7', '5d9d00fd-6912-4709-9c2f-842b3a7bf6dd'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:55:53 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:55:53 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:55:53 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.240s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:55:53 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Deleted volume successfully. Sep 09 03:55:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1deab12e-445d-45ba-8966-48e64d692554 tempest-VolumeImageDependencyTests-654861642 None] Lock "cinder-37c6a4fb-a888-4cd0-9916-7a9603b762f3-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:03 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:INSERT=9 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:56:03 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=11,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:56:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-e888f14f-92b9-468a-8101-edcb519cf02b req-eed7cfe4-ea9e-4824-8501-7f5af2030209 tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-e888f14f-92b9-468a-8101-edcb519cf02b req-eed7cfe4-ea9e-4824-8501-7f5af2030209 tempest-TestStampPattern-2030243761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [req-e888f14f-92b9-468a-8101-edcb519cf02b req-eed7cfe4-ea9e-4824-8501-7f5af2030209 tempest-TestStampPattern-2030243761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-e888f14f-92b9-468a-8101-edcb519cf02b req-eed7cfe4-ea9e-4824-8501-7f5af2030209 tempest-TestStampPattern-2030243761 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f', 'name': 'volume-35a87d44-b111-4413-8016-39a9ce1ce4ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b71d0177-5fdc-47bf-a174-3118cf0b8bbf', 'enforce_multipath': True} {{(pid=87597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 03:56:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-e888f14f-92b9-468a-8101-edcb519cf02b req-eed7cfe4-ea9e-4824-8501-7f5af2030209 tempest-TestStampPattern-2030243761 None] attachment_update completed successfully. Sep 09 03:56:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [req-26397e8b-8497-4cd0-a210-cd0aa2af9962 req-b4aaba99-534b-477c-bd07-57898ffef037 tempest-TestStampPattern-2030243761 None] Terminate volume connection completed successfully. Sep 09 03:56:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [req-26397e8b-8497-4cd0-a210-cd0aa2af9962 req-b4aaba99-534b-477c-bd07-57898ffef037 tempest-TestStampPattern-2030243761 None] Deleting attachment b71d0177-5fdc-47bf-a174-3118cf0b8bbf. {{(pid=87597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-35a87d44-b111-4413-8016-39a9ce1ce4ca-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Lock "cinder-35a87d44-b111-4413-8016-39a9ce1ce4ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-quobyte-35a87d44-b111-4413-8016-39a9ce1ce4ca" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-35a87d44-b111-4413-8016-39a9ce1ce4ca" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8323699c-a55d-444e-96c4-489391d46b0f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:24 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca Sep 09 03:56:24 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:24 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca" returned: 0 in 0.367s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:24 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca Sep 09 03:56:24 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:24 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-35a87d44-b111-4413-8016-39a9ce1ce4ca" returned: 0 in 0.251s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-35a87d44-b111-4413-8016-39a9ce1ce4ca" released by "delete_volume" :: held 0.662s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Created reservations ['b1437060-2193-494c-9524-4aed45a28a5c', '673df7af-7481-44ee-aa53-61af8b9abce9', '9b1c2e3d-3808-41c0-bb55-bca47d6bd157', '339a298f-0325-43f0-8c16-397fb5da71ee'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:25 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:56:25 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:25 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.245s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:56:25 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Deleted volume successfully. Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-42ec0275-11e0-4496-8b2d-87b144cd7fe2 tempest-TestStampPattern-2030243761 None] Lock "cinder-35a87d44-b111-4413-8016-39a9ce1ce4ca-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-b231c9f3-a574-4a1a-817b-510c67524efc-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Lock "cinder-b231c9f3-a574-4a1a-817b-510c67524efc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-quobyte-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-quobyte-b231c9f3-a574-4a1a-817b-510c67524efc" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-b231c9f3-a574-4a1a-817b-510c67524efc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Deleting offline snapshot b231c9f3-a574-4a1a-817b-510c67524efc of volume bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] snapshot_file for this snap is: volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fb8070-c99b-4db6-ad81-df6c787d4431]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:25 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc Sep 09 03:56:25 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:26 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc" returned: 0 in 0.402s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f2b0e3-5f61-490a-8303-350c94463d6c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:26 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 Sep 09 03:56:26 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:26 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" returned: 0 in 0.547s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:26 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc Sep 09 03:56:26 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Flow 'volume_create_manager' (78656adb-e9a5-400e-838e-f83747b9f276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a28876-a406-4d04-82be-8b8ae6f6d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a28876-a406-4d04-82be-8b8ae6f6d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-22527256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5db4bc-fd40-49b2-9dd0-8db92962a63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffc551e36654a73be474357dc70ad26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:27Z,use_quota=True,user_id='fd1e16478bad4d9cb1ba903b2961fe1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccf6cbf-c520-4aaa-8a49-da6377cd3d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccf6cbf-c520-4aaa-8a49-da6377cd3d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379996dd-2119-4c6d-aed6-4d42ee6ce0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379996dd-2119-4c6d-aed6-4d42ee6ce0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5db4bc-fd40-49b2-9dd0-8db92962a63b', 'volume_name': 'volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127b6349-1de7-41b8-9006-9fa293f72e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127b6349-1de7-41b8-9006-9fa293f72e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3c1e26-73b7-4ee0-a7f2-5e5a5a039bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:26 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Volume 4c5db4bc-fd40-49b2-9dd0-8db92962a63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b', 'volume_size': 1} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-22527256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5db4bc-fd40-49b2-9dd0-8db92962a63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffc551e36654a73be474357dc70ad26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:27Z,use_quota=True,user_id='fd1e16478bad4d9cb1ba903b2961fe1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Creating volume 4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:56:26 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:56:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:26 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b 1073741824 Sep 09 03:56:26 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:27 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc" returned: 0 in 0.340s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:27 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc Sep 09 03:56:27 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:27 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2.b231c9f3-a574-4a1a-817b-510c67524efc" returned: 0 in 0.246s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:27 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b 1073741824" returned: 0 in 0.403s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-b231c9f3-a574-4a1a-817b-510c67524efc" released by "_delete_snapshot" :: held 1.640s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" released by "delete_snapshot" :: held 1.667s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:27 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b Sep 09 03:56:27 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Created reservations ['032ca51a-cbf5-48b0-a9b9-4a4cfc791e4a', '1e335ab3-553c-452e-a52c-6683d88f61f8', '296b3bf0-252d-4979-b3b4-691b23f2493e', 'cef831ec-f0a8-46ed-a660-10b0711125cd'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:56:27 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Delete snapshot completed successfully. Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-85a9c91a-bfeb-4bf8-b870-b07b9d41cc1d tempest-TestStampPattern-2030243761 None] Lock "cinder-b231c9f3-a574-4a1a-817b-510c67524efc-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:27 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3c1e26-73b7-4ee0-a7f2-5e5a5a039bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e691029-5e39-490a-8bf4-03b9bcbd5aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:27 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Volume volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b (4c5db4bc-fd40-49b2-9dd0-8db92962a63b): created successfully Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e691029-5e39-490a-8bf4-03b9bcbd5aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Flow 'volume_create_manager' (78656adb-e9a5-400e-838e-f83747b9f276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:56:27 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-10397fc1-450d-47ac-8492-142ad81daf9e tempest-SnapshotDependencyTests-2008093896 None] Created volume successfully. Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Creating offline snapshot 9c13f8f3-d70d-481c-80de-077e22dd9f8e of volume 4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f86be6-38c1-470d-847d-5132f7aa0671]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:28 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b Sep 09 03:56:28 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:28 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" returned: 0 in 0.397s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:28 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e 1G Sep 09 03:56:28 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:28 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e 1G" returned: 0 in 0.466s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:29 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e Sep 09 03:56:29 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:29 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e" returned: 0 in 0.482s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:29 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e is being set with open permissions: ugo+rw Sep 09 03:56:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:29 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e Sep 09 03:56:29 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:29 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e" returned: 0 in 0.268s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:29 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.info Sep 09 03:56:29 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:30 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.info" returned: 0 in 0.306s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:30 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.info is being set with open permissions: ugo+rw Sep 09 03:56:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:30 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.info Sep 09 03:56:30 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:30 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.info" returned: 0 in 0.304s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:30 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ee5aaa3d-91f2-4127-875d-a20cee63d872 tempest-SnapshotDependencyTests-2008093896 None] Create snapshot completed successfully Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Lock "cinder-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Acquiring lock "cinder-quobyte-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" acquired by "delete_volume" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac47a9b9-a228-489c-9b47-0c4f7105519f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:31 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 Sep 09 03:56:31 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Flow 'volume_create_manager' (d4d96522-b248-4737-8b46-b6d033850f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:56:31 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7383f50-515e-42ac-a324-7d91ecc7355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" returned: 0 in 0.374s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7383f50-515e-42ac-a324-7d91ecc7355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d052262e-0284-4bfb-90f0-15ea7f6d9ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffc551e36654a73be474357dc70ad26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c13f8f3-d70d-481c-80de-077e22dd9f8e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:32Z,use_quota=True,user_id='fd1e16478bad4d9cb1ba903b2961fe1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:31 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2 Sep 09 03:56:31 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eed108-a816-4d7f-8fbf-8e791504f5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eed108-a816-4d7f-8fbf-8e791504f5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab63af4-7961-4f0a-ac21-56b7e3898b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab63af4-7961-4f0a-ac21-56b7e3898b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd052262e-0284-4bfb-90f0-15ea7f6d9ed6', 'volume_name': 'volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6', 'volume_size': 1, 'snapshot_id': '9c13f8f3-d70d-481c-80de-077e22dd9f8e'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c90002a-1723-49b9-bdb0-785ddb8692cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c90002a-1723-49b9-bdb0-785ddb8692cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6472f369-f316-44c2-9454-3436ff81c084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Volume d052262e-0284-4bfb-90f0-15ea7f6d9ed6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6', 'volume_size': 1, 'snapshot_id': '9c13f8f3-d70d-481c-80de-077e22dd9f8e'} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-quobyte-9c13f8f3-d70d-481c-80de-077e22dd9f8e-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-9c13f8f3-d70d-481c-80de-077e22dd9f8e-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Creating volume d052262e-0284-4bfb-90f0-15ea7f6d9ed6 from snapshot 9c13f8f3-d70d-481c-80de-077e22dd9f8e {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-quobyte-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] snapshot: 9c13f8f3-d70d-481c-80de-077e22dd9f8e, volume: d052262e-0284-4bfb-90f0-15ea7f6d9ed6, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94217e5-22f5-41a7-af6f-9930950be334]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:32 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" returned: 0 in 0.250s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Lock "cinder-quobyte-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2" released by "delete_volume" :: held 0.681s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:32 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e Sep 09 03:56:32 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Created reservations ['45738e37-b0b1-4b53-a159-2c855594c3ce', 'de13cf19-3598-424d-a5dd-f4d0efee1e75', '89d3aba8-e729-429e-9047-6ab8f49d60d4', '9c4e4ac3-5e9a-4fa8-aafb-3b6a72883137'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:32 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:56:32 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:32 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e" returned: 0 in 0.371s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1028823b-d656-4e7e-9c98-0c3978cbd278]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:32 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:56:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Deleted volume successfully. Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-46ab1ea8-2fba-4a86-a0b6-c8f297b0c50a tempest-TestStampPattern-2030243761 None] Lock "cinder-bcd1bfd5-ab1b-4a7c-af0d-647df3a484c2-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:32 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b Sep 09 03:56:32 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:32 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" returned: 0 in 0.416s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:56:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:32 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 Sep 09 03:56:32 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:37 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:56:37 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:37 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" returned: 0 in 4.963s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:56:37 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Converted 1024.00 MB image at 206.27 MB/s Sep 09 03:56:37 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 is being set with open permissions: ugo+rw Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:37 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 Sep 09 03:56:37 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:37 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.564s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:56:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:56:38 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" returned: 0 in 0.247s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" released by "_copy_volume_from_snapshot" :: held 6.083s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-9c13f8f3-d70d-481c-80de-077e22dd9f8e-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" released by "_create_volume_from_snapshot" :: held 6.148s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.163s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6472f369-f316-44c2-9454-3436ff81c084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6', 'volume_size': 1, 'snapshot_id': '9c13f8f3-d70d-481c-80de-077e22dd9f8e'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a3c19c-cb58-4065-9625-5a35a7000c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Volume volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 (d052262e-0284-4bfb-90f0-15ea7f6d9ed6): created successfully Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a3c19c-cb58-4065-9625-5a35a7000c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Flow 'volume_create_manager' (d4d96522-b248-4737-8b46-b6d033850f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:56:38 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cb98ed3e-fdc5-4f5c-9e5e-af46a6f8a65a tempest-SnapshotDependencyTests-2008093896 None] Created volume successfully. Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-9c13f8f3-d70d-481c-80de-077e22dd9f8e-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-9c13f8f3-d70d-481c-80de-077e22dd9f8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-quobyte-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-quobyte-9c13f8f3-d70d-481c-80de-077e22dd9f8e" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-9c13f8f3-d70d-481c-80de-077e22dd9f8e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Deleting offline snapshot 9c13f8f3-d70d-481c-80de-077e22dd9f8e of volume 4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] snapshot_file for this snap is: volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc72449-e0f7-4c51-9619-724749a080ac]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:38 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e Sep 09 03:56:38 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:39 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e" returned: 0 in 0.396s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:56:39 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcba13f-26c9-45a4-9671-a40fcf94e01e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:39 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b Sep 09 03:56:39 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:39 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" returned: 0 in 0.575s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:39 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e Sep 09 03:56:39 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:40 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e" returned: 0 in 0.351s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:40 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e Sep 09 03:56:40 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:40 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b.9c13f8f3-d70d-481c-80de-077e22dd9f8e" returned: 0 in 0.259s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-9c13f8f3-d70d-481c-80de-077e22dd9f8e" released by "_delete_snapshot" :: held 1.686s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" released by "delete_snapshot" :: held 1.711s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Created reservations ['f4c14222-befb-4348-9cda-ec8baa503590', '2797b2f0-3387-4c9b-9833-61b26b1708de', '02e532b6-6fa2-4791-bbdc-4ceec43e5b1a', '1974f504-d710-4fae-9509-2a76fcc7309e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:56:40 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Delete snapshot completed successfully. Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fa5652f0-e290-4526-a1ec-846e6b21e9e1 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-9c13f8f3-d70d-481c-80de-077e22dd9f8e-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-4c5db4bc-fd40-49b2-9dd0-8db92962a63b-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-4c5db4bc-fd40-49b2-9dd0-8db92962a63b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-quobyte-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeeed03-274d-43e5-b98a-7363065b063d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:41 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b Sep 09 03:56:41 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:41 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" returned: 0 in 0.364s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:41 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b Sep 09 03:56:41 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:41 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" returned: 0 in 0.284s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-4c5db4bc-fd40-49b2-9dd0-8db92962a63b" released by "delete_volume" :: held 0.712s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Created reservations ['fcf68205-459c-4cf8-909a-215b02209b98', '5d767c7f-59c3-4c49-bb95-35e699077213', 'edd698ca-95b5-4d76-9514-dbf7bb9e8719', '97f618f6-1854-448a-b971-c4006327375a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:41 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:56:41 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:42 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.263s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-d052262e-0284-4bfb-90f0-15ea7f6d9ed6-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Deleted volume successfully. Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-d052262e-0284-4bfb-90f0-15ea7f6d9ed6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-08330d35-8bec-4b40-a78d-0ff7fd5833ed tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-4c5db4bc-fd40-49b2-9dd0-8db92962a63b-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "cinder-quobyte-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e955cff-63d3-4bba-a9c2-36401d4b0648]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:42 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 Sep 09 03:56:42 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:42 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" returned: 0 in 0.381s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:42 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6 Sep 09 03:56:42 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:42 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" returned: 0 in 0.305s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-quobyte-d052262e-0284-4bfb-90f0-15ea7f6d9ed6" released by "delete_volume" :: held 0.729s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Created reservations ['d0c6d964-82c4-445c-9206-eccb017714e6', '17607918-430e-4a17-8e8f-3de054d660af', '8c554dc0-524a-4eb3-b1a5-ce7bce4dc936', '35ca1fbc-cfee-4753-82b5-aa70f734a67b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:43 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:56:43 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:43 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.262s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:56:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Deleted volume successfully. Sep 09 03:56:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fc205c5e-5a95-4247-a9af-8d0c0999e824 tempest-SnapshotDependencyTests-2008093896 None] Lock "cinder-d052262e-0284-4bfb-90f0-15ea7f6d9ed6-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:50 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:56:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Flow 'volume_create_manager' (6f7c067d-d2c6-4ecd-804a-82d6b3a55f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:56:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202eca1d-0ac5-46e1-a389-31e6421a19ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202eca1d-0ac5-46e1-a389-31e6421a19ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ded0fba7a145138ec953268f80cc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:51Z,use_quota=True,user_id='15313672aa73437aa05de788c393a44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a17fcf26-e33d-46f2-a702-3aca486df854),volume_type_id=a17fcf26-e33d-46f2-a702-3aca486df854)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72326b80-a0ca-4c0b-9e71-b5813be2d933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72326b80-a0ca-4c0b-9e71-b5813be2d933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15532913-2910-4a3a-a80c-f9fae82a3e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:50 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15532913-2910-4a3a-a80c-f9fae82a3e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7', 'volume_name': 'volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7', 'volume_size': 1, 'image_id': '8b1405f0-9598-4105-8af9-1a88b1e54e65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b1405f0-9598-4105-8af9-1a88b1e54e65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23dbe8d8b3adc362601f579805d67578', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0ded0fba7a145138ec953268f80cc8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9320a295ea28fcdd6823468e9a8b373962cb7f61a31c42a5f87a9d1fbd00af22201ce2a7429e263d948b385a80d1842e3417cdc3e185806fb42826a37d550a2', 'id': '8b1405f0-9598-4105-8af9-1a88b1e54e65', 'created_at': datetime.datetime(2026, 9, 9, 1, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b1405f0-9598-4105-8af9-1a88b1e54e65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a648709-5b75-4398-82ba-a3e3857a9771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a648709-5b75-4398-82ba-a3e3857a9771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11e48e0-b567-47c9-be6b-b172a0446f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:51 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Volume 5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7', 'volume_size': 1, 'image_id': '8b1405f0-9598-4105-8af9-1a88b1e54e65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b1405f0-9598-4105-8af9-1a88b1e54e65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23dbe8d8b3adc362601f579805d67578', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0ded0fba7a145138ec953268f80cc8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9320a295ea28fcdd6823468e9a8b373962cb7f61a31c42a5f87a9d1fbd00af22201ce2a7429e263d948b385a80d1842e3417cdc3e185806fb42826a37d550a2', 'id': '8b1405f0-9598-4105-8af9-1a88b1e54e65', 'created_at': datetime.datetime(2026, 9, 9, 1, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b1405f0-9598-4105-8af9-1a88b1e54e65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Trying to clone 5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 from image 8b1405f0-9598-4105-8af9-1a88b1e54e65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b1405f0-9598-4105-8af9-1a88b1e54e65', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:56:51 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Image download 0.00 MB at 0.00 MB/s Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[96048d0e-5078-4d5b-a49c-0fc85909ed5d]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:51 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD Sep 09 03:56:51 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:51 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:51 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD Sep 09 03:56:51 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:51 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Temporary image 8b1405f0-9598-4105-8af9-1a88b1e54e65 is fetched for user 15313672aa73437aa05de788c393a44d. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6593b5f1-61eb-40b2-a807-e66afe02bbca]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:52 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD Sep 09 03:56:52 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:52 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:52 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD Sep 09 03:56:52 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:52 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ded0fba7a145138ec953268f80cc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:56:51Z,use_quota=True,user_id='15313672aa73437aa05de788c393a44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a17fcf26-e33d-46f2-a702-3aca486df854),volume_type_id=a17fcf26-e33d-46f2-a702-3aca486df854)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Creating volume 5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:56:52 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:56:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:52 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 1073741824 Sep 09 03:56:52 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:53 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 1073741824" returned: 0 in 0.493s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:53 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 Sep 09 03:56:53 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:53 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7" returned: 0 in 0.275s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:56:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:53 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Attempting download of 8b1405f0-9598-4105-8af9-1a88b1e54e65 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b1405f0-9598-4105-8af9-1a88b1e54e65', 'metadata': {}}])) to volume 5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:56:53 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4625fc9d-ae6a-41e9-b7c3-35db342c5e20]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b1405f0-9598-4105-8af9-1a88b1e54e65_zxmfd077 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:53 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b1405f0-9598-4105-8af9-1a88b1e54e65_zxmfd077 Sep 09 03:56:53 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:54 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b1405f0-9598-4105-8af9-1a88b1e54e65_zxmfd077" returned: 0 in 0.338s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b1405f0-9598-4105-8af9-1a88b1e54e65_zxmfd077 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:54 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b1405f0-9598-4105-8af9-1a88b1e54e65_zxmfd077 Sep 09 03:56:54 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:54 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b1405f0-9598-4105-8af9-1a88b1e54e65_zxmfd077" returned: 1 in 0.349s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b1405f0-9598-4105-8af9-1a88b1e54e65_zxmfd077' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:56:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ef12e9-f8d5-409d-bde3-a457bd135acf]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:54 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD Sep 09 03:56:54 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:54 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:54 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD Sep 09 03:56:54 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:55 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] 8b1405f0-9598-4105-8af9-1a88b1e54e65 was raw, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:55 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 Sep 09 03:56:55 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:55 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7" returned: 0 in 0.432s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b1405f0-9598-4105-8af9-1a88b1e54e65_r_8sqbupdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:56:55 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:55 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 1G Sep 09 03:56:55 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:55 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 1G" returned: 0 in 0.301s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Downloaded image 8b1405f0-9598-4105-8af9-1a88b1e54e65 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b1405f0-9598-4105-8af9-1a88b1e54e65', 'metadata': {}}])) to volume 5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Temporary image 8b1405f0-9598-4105-8af9-1a88b1e54e65 for user 15313672aa73437aa05de788c393a44d is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Marking volume 5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Copying metadata from image 8b1405f0-9598-4105-8af9-1a88b1e54e65 to 5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Creating volume glance metadata for volume 5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 backed by image 8b1405f0-9598-4105-8af9-1a88b1e54e65 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8b1405f0-9598-4105-8af9-1a88b1e54e65', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '23dbe8d8b3adc362601f579805d67578', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11e48e0-b567-47c9-be6b-b172a0446f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7', 'volume_size': 1, 'image_id': '8b1405f0-9598-4105-8af9-1a88b1e54e65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b1405f0-9598-4105-8af9-1a88b1e54e65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23dbe8d8b3adc362601f579805d67578', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0ded0fba7a145138ec953268f80cc8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9320a295ea28fcdd6823468e9a8b373962cb7f61a31c42a5f87a9d1fbd00af22201ce2a7429e263d948b385a80d1842e3417cdc3e185806fb42826a37d550a2', 'id': '8b1405f0-9598-4105-8af9-1a88b1e54e65', 'created_at': datetime.datetime(2026, 9, 9, 1, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 56, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b1405f0-9598-4105-8af9-1a88b1e54e65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b23390-37c9-4c11-885d-6090a1c89c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:56:55 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Volume volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 (5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7): created successfully Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b23390-37c9-4c11-885d-6090a1c89c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:56:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Flow 'volume_create_manager' (6f7c067d-d2c6-4ecd-804a-82d6b3a55f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:56:55 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-7bf33971-ec68-4d7e-92c3-814996914039 tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Created volume successfully. Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Acquiring lock "cinder-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "cinder-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Acquiring lock "cinder-quobyte-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "cinder-quobyte-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c10b53-83e7-464d-b158-2ef247df726b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:56 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 Sep 09 03:56:56 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:56 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7" returned: 0 in 0.360s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:56 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7 Sep 09 03:56:56 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:56 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7" returned: 0 in 0.256s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "cinder-quobyte-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7" released by "delete_volume" :: held 0.657s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:56:56 devstack cinder-volume[87597]: WARNING cinder.quota [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:56:56 devstack cinder-volume[87597]: WARNING cinder.quota [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Created reservations ['468a3c63-ce9a-412d-863e-5602c57825a7', '99cb41f6-3e70-40aa-970c-238c08791ca2', 'c66b593f-130c-4fe2-94a2-5168310ce6dd', '5e38d76c-104e-4864-8d3d-40693069cd24'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:56:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:56:56 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:56:56 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:56:57 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 09 03:56:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.251s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:56:57 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:56:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Deleted volume successfully. Sep 09 03:56:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a3c32080-18be-4ffd-942e-09793f7b93ad tempest-VolumeAndVolumeTypeFromImageTest-3849867 None] Lock "cinder-5c6cdbc1-a278-4b4f-a86b-cfb9dec646a7-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Flow 'volume_create_manager' (b7daa4e4-157f-458b-93eb-708f807c234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbee662-0006-4c68-8d08-4a3a2965707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbee662-0006-4c68-8d08-4a3a2965707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-194656902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddf3b0c-7084-48fb-9520-539feb73494f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454a2f9d78884172bc2bd101791eff0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:02Z,use_quota=True,user_id='864132c225fe49599509f85d1e74ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508a353a-4230-468b-a0bf-c67c74c7aa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508a353a-4230-468b-a0bf-c67c74c7aa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6aefd7-c0ad-4da5-b15f-813c37ec32e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6aefd7-c0ad-4da5-b15f-813c37ec32e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddf3b0c-7084-48fb-9520-539feb73494f', 'volume_name': 'volume-4ddf3b0c-7084-48fb-9520-539feb73494f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7f38ea-faca-4389-a3b4-0568f2123dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7f38ea-faca-4389-a3b4-0568f2123dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809a2bca-9ced-4ee6-9dfa-7c263b940769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:01 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Volume 4ddf3b0c-7084-48fb-9520-539feb73494f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddf3b0c-7084-48fb-9520-539feb73494f', 'volume_size': 1} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-194656902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddf3b0c-7084-48fb-9520-539feb73494f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454a2f9d78884172bc2bd101791eff0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:02Z,use_quota=True,user_id='864132c225fe49599509f85d1e74ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Creating volume 4ddf3b0c-7084-48fb-9520-539feb73494f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:01 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:01 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f 1073741824 Sep 09 03:57:01 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:02 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f 1073741824" returned: 0 in 0.410s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:02 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f Sep 09 03:57:02 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:02 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f" returned: 0 in 0.252s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809a2bca-9ced-4ee6-9dfa-7c263b940769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddf3b0c-7084-48fb-9520-539feb73494f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6755a0-937f-4d4e-9a7f-8da8a7b43d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:02 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Volume volume-4ddf3b0c-7084-48fb-9520-539feb73494f (4ddf3b0c-7084-48fb-9520-539feb73494f): created successfully Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6755a0-937f-4d4e-9a7f-8da8a7b43d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Flow 'volume_create_manager' (b7daa4e4-157f-458b-93eb-708f807c234c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:02 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-87d89fa6-ddd1-4dec-bfd2-411c58a92924 tempest-ProjectReaderTests-1001067221 None] Created volume successfully. Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Acquiring lock "cinder-4ddf3b0c-7084-48fb-9520-539feb73494f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Lock "cinder-4ddf3b0c-7084-48fb-9520-539feb73494f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Acquiring lock "cinder-quobyte-4ddf3b0c-7084-48fb-9520-539feb73494f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Lock "cinder-quobyte-4ddf3b0c-7084-48fb-9520-539feb73494f" acquired by "delete_volume" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2eae3b-955a-489e-a146-36377eb775e7]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:03 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f Sep 09 03:57:03 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:03 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f" returned: 0 in 0.353s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:03 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f Sep 09 03:57:03 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:03 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4ddf3b0c-7084-48fb-9520-539feb73494f" returned: 0 in 0.262s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Lock "cinder-quobyte-4ddf3b0c-7084-48fb-9520-539feb73494f" released by "delete_volume" :: held 0.651s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Created reservations ['bcc93d80-2cc6-4d71-925e-c7ceece9ab5f', 'bde46ac6-34ff-45ff-9257-4ec9ed932a24', '63fd1d18-ec64-4e18-b414-6692fabf3359', '3ac66dfe-7906-47a4-9732-9709bd92087f'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:03 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:03 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:04 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.276s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Deleted volume successfully. Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-5d267088-d442-4b7e-8f53-f59d4785976e tempest-ProjectReaderTests-1001067221 None] Lock "cinder-4ddf3b0c-7084-48fb-9520-539feb73494f-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Flow 'volume_create_manager' (99121ef9-81b5-4027-8d2b-5155a121afd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0955b99-e177-4ffd-a47c-affd4fc7cdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0955b99-e177-4ffd-a47c-affd4fc7cdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033643053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3550433-2053-4b3a-b014-627313690fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454a2f9d78884172bc2bd101791eff0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:05Z,use_quota=True,user_id='864132c225fe49599509f85d1e74ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ad3167-183c-4a81-a047-17b60c6f43ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ad3167-183c-4a81-a047-17b60c6f43ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e100bb5e-8015-4195-b0f4-943e900fd98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e100bb5e-8015-4195-b0f4-943e900fd98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3550433-2053-4b3a-b014-627313690fc0', 'volume_name': 'volume-a3550433-2053-4b3a-b014-627313690fc0', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612cac22-966e-4d05-8ee6-b497f2b2aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612cac22-966e-4d05-8ee6-b497f2b2aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba376c46-e53c-4dc1-9f05-7a93d38b3b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:04 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Volume a3550433-2053-4b3a-b014-627313690fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3550433-2053-4b3a-b014-627313690fc0', 'volume_size': 1} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033643053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3550433-2053-4b3a-b014-627313690fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454a2f9d78884172bc2bd101791eff0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:05Z,use_quota=True,user_id='864132c225fe49599509f85d1e74ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Creating volume a3550433-2053-4b3a-b014-627313690fc0 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:04 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:04 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 1073741824 Sep 09 03:57:04 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:05 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 1073741824" returned: 0 in 0.403s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:05 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 Sep 09 03:57:05 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:05 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0" returned: 0 in 0.243s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba376c46-e53c-4dc1-9f05-7a93d38b3b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3550433-2053-4b3a-b014-627313690fc0', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de8825f-b34f-4b4e-904f-e37b774f27b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:05 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Volume volume-a3550433-2053-4b3a-b014-627313690fc0 (a3550433-2053-4b3a-b014-627313690fc0): created successfully Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de8825f-b34f-4b4e-904f-e37b774f27b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Flow 'volume_create_manager' (99121ef9-81b5-4027-8d2b-5155a121afd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:05 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-250b5d3c-1178-442f-88e8-45d5b413a03b tempest-ProjectReaderTests-1001067221 None] Created volume successfully. Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Acquiring lock "cinder-a3550433-2053-4b3a-b014-627313690fc0-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Lock "cinder-a3550433-2053-4b3a-b014-627313690fc0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Acquiring lock "cinder-quobyte-a3550433-2053-4b3a-b014-627313690fc0" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Lock "cinder-quobyte-a3550433-2053-4b3a-b014-627313690fc0" acquired by "delete_volume" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be1a2b8-f730-495d-9a9b-47f5b4343e31]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:05 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 Sep 09 03:57:05 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:06 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0" returned: 0 in 0.350s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:06 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0 Sep 09 03:57:06 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:06 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a3550433-2053-4b3a-b014-627313690fc0" returned: 0 in 0.249s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Lock "cinder-quobyte-a3550433-2053-4b3a-b014-627313690fc0" released by "delete_volume" :: held 0.637s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Created reservations ['80a10a02-35cc-4000-9a5d-ea5d99f5c8ed', '5ad9e0ce-4b63-4451-9ec6-51de16662306', 'bc8417d2-19ae-4155-8d25-1a5f18c1b338', '04334424-d38c-4ed5-865a-b18ddadb9161'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:06 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:06 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:06 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.242s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:06 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Deleted volume successfully. Sep 09 03:57:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a273c21a-c116-45c5-881c-4e5094616362 tempest-ProjectReaderTests-1001067221 None] Lock "cinder-a3550433-2053-4b3a-b014-627313690fc0-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Flow 'volume_create_manager' (3a2148aa-ca1e-4e6b-b8dd-5a27e2753bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edb1c48-e76e-4b6b-9496-8854c2df2413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edb1c48-e76e-4b6b-9496-8854c2df2413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806751323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0621234a-0e1c-4480-ab67-2f1074a85a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d872bc53449c3a4aba709b730b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:10Z,use_quota=True,user_id='9b3c3526a02646959eb307924e6d6fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22cd790-8e11-4d67-8ecb-402eb36c16e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22cd790-8e11-4d67-8ecb-402eb36c16e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3788f9-8c05-4cce-b313-53b6dbf34da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3788f9-8c05-4cce-b313-53b6dbf34da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0621234a-0e1c-4480-ab67-2f1074a85a8f', 'volume_name': 'volume-0621234a-0e1c-4480-ab67-2f1074a85a8f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e0b07f-51b9-411b-8395-59ba67b4e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e0b07f-51b9-411b-8395-59ba67b4e13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4804d7-ea78-426e-9f24-427e41729208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Volume 0621234a-0e1c-4480-ab67-2f1074a85a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0621234a-0e1c-4480-ab67-2f1074a85a8f', 'volume_size': 1} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806751323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0621234a-0e1c-4480-ab67-2f1074a85a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d872bc53449c3a4aba709b730b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:10Z,use_quota=True,user_id='9b3c3526a02646959eb307924e6d6fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Creating volume 0621234a-0e1c-4480-ab67-2f1074a85a8f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:10 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:10 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f 1073741824 Sep 09 03:57:10 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:10 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f 1073741824" returned: 0 in 0.402s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:10 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f Sep 09 03:57:10 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:10 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f" returned: 0 in 0.240s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4804d7-ea78-426e-9f24-427e41729208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0621234a-0e1c-4480-ab67-2f1074a85a8f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728ebd5b-44a3-48c4-a910-ad454106dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Volume volume-0621234a-0e1c-4480-ab67-2f1074a85a8f (0621234a-0e1c-4480-ab67-2f1074a85a8f): created successfully Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728ebd5b-44a3-48c4-a910-ad454106dddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Flow 'volume_create_manager' (3a2148aa-ca1e-4e6b-b8dd-5a27e2753bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cf0c53e2-01a4-4ac5-be63-d1f75a440683 tempest-ProjectReaderTests-1582153101 None] Created volume successfully. Sep 09 03:57:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "cinder-0621234a-0e1c-4480-ab67-2f1074a85a8f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-0621234a-0e1c-4480-ab67-2f1074a85a8f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "cinder-quobyte-0621234a-0e1c-4480-ab67-2f1074a85a8f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-quobyte-0621234a-0e1c-4480-ab67-2f1074a85a8f" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:11 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbba832-2b0b-45ee-b051-0af489eb00b1]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:11 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f Sep 09 03:57:11 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:11 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f" returned: 0 in 0.363s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:11 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f Sep 09 03:57:11 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:12 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-0621234a-0e1c-4480-ab67-2f1074a85a8f" returned: 0 in 0.240s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-quobyte-0621234a-0e1c-4480-ab67-2f1074a85a8f" released by "delete_volume" :: held 0.642s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Created reservations ['f9ecb56c-9551-400d-91f2-f7cdc7a97ac6', '3ff3b88a-6506-4b0a-a8ff-ffeee8fd5462', 'e837de20-7550-4f4b-a3a2-f03622a9ca15', 'fed3ecbe-c220-4f2d-9279-09b1b712f7f9'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:12 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:12 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:12 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.245s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Deleted volume successfully. Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0a02f58b-8d7e-4680-9213-56a8c003a388 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-0621234a-0e1c-4480-ab67-2f1074a85a8f-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Flow 'volume_create_manager' (1a18df8e-fe37-401c-8f04-cbbdfc244c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e438c158-332e-4879-b948-19d7a5d7fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e438c158-332e-4879-b948-19d7a5d7fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501704116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8824cfb-1608-46f8-b40a-9cd2990c3f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d872bc53449c3a4aba709b730b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:13Z,use_quota=True,user_id='9b3c3526a02646959eb307924e6d6fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3564a6d6-0c7b-449e-ac77-3aa095c0b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3564a6d6-0c7b-449e-ac77-3aa095c0b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20eb8659-a696-45e8-86f7-058c2b862df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20eb8659-a696-45e8-86f7-058c2b862df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8824cfb-1608-46f8-b40a-9cd2990c3f22', 'volume_name': 'volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcaed0f6-c2aa-4239-9f2d-b42d075fdc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcaed0f6-c2aa-4239-9f2d-b42d075fdc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1c7020-f421-45f2-a021-30350cc27090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:12 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Volume b8824cfb-1608-46f8-b40a-9cd2990c3f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22', 'volume_size': 1} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501704116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8824cfb-1608-46f8-b40a-9cd2990c3f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d872bc53449c3a4aba709b730b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:13Z,use_quota=True,user_id='9b3c3526a02646959eb307924e6d6fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Creating volume b8824cfb-1608-46f8-b40a-9cd2990c3f22 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:13 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:13 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 1073741824 Sep 09 03:57:13 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:13 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 1073741824" returned: 0 in 0.398s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=73,cinder:UPDATE=100,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:13 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 Sep 09 03:57:13 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:13 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22" returned: 0 in 0.243s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1c7020-f421-45f2-a021-30350cc27090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed9e7f7-311c-4f1c-9e52-2ef1f45acdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=95,cinder:UPDATE=101,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:57:13 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Volume volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 (b8824cfb-1608-46f8-b40a-9cd2990c3f22): created successfully Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed9e7f7-311c-4f1c-9e52-2ef1f45acdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Flow 'volume_create_manager' (1a18df8e-fe37-401c-8f04-cbbdfc244c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f49e2037-55f4-48d2-b811-60bdaf800098 tempest-ProjectReaderTests-1582153101 None] Created volume successfully. Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Acquiring lock "cinder-b8824cfb-1608-46f8-b40a-9cd2990c3f22-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Lock "cinder-b8824cfb-1608-46f8-b40a-9cd2990c3f22-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Acquiring lock "cinder-quobyte-b8824cfb-1608-46f8-b40a-9cd2990c3f22" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Lock "cinder-quobyte-b8824cfb-1608-46f8-b40a-9cd2990c3f22" acquired by "delete_volume" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da25c3c-83aa-40eb-84d5-4c31696837d1]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:14 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 Sep 09 03:57:14 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:14 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22" returned: 0 in 0.372s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:14 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22 Sep 09 03:57:14 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:14 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-b8824cfb-1608-46f8-b40a-9cd2990c3f22" returned: 0 in 0.244s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Lock "cinder-quobyte-b8824cfb-1608-46f8-b40a-9cd2990c3f22" released by "delete_volume" :: held 0.653s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Created reservations ['f64493ed-04de-4da7-896e-5fa83c2a3658', 'd81bcd76-a3ec-4297-b6e6-112480fe3bfd', 'b4bd5f6d-403e-4fb4-b76d-17e1eb7ff89a', 'c332e00f-b0e7-45c4-b596-7fad6929502c'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:14 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:14 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:15 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.241s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Deleted volume successfully. Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317be80c-640b-4749-96b6-f96abb7a575a tempest-ProjectReaderTests-1582153101 None] Lock "cinder-b8824cfb-1608-46f8-b40a-9cd2990c3f22-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Flow 'volume_create_manager' (9e9e3cfc-17d0-42af-9e1c-57a8f01725bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a9b806-8dfe-482f-82e0-55ce8440ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a9b806-8dfe-482f-82e0-55ce8440ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-270774228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be83974c-e772-4f28-92da-3fabf8d99429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d872bc53449c3a4aba709b730b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:16Z,use_quota=True,user_id='9b3c3526a02646959eb307924e6d6fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8263b3-ac7f-4e95-931f-640d67e994db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8263b3-ac7f-4e95-931f-640d67e994db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cf4512-9763-4b6f-9935-46139b54f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cf4512-9763-4b6f-9935-46139b54f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be83974c-e772-4f28-92da-3fabf8d99429', 'volume_name': 'volume-be83974c-e772-4f28-92da-3fabf8d99429', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266a8f76-0094-4581-8c98-211ada7c1ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266a8f76-0094-4581-8c98-211ada7c1ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0156c0a-2433-4aaa-9ae2-72c524c7d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:15 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Volume be83974c-e772-4f28-92da-3fabf8d99429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be83974c-e772-4f28-92da-3fabf8d99429', 'volume_size': 1} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-270774228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be83974c-e772-4f28-92da-3fabf8d99429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d872bc53449c3a4aba709b730b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:16Z,use_quota=True,user_id='9b3c3526a02646959eb307924e6d6fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Creating volume be83974c-e772-4f28-92da-3fabf8d99429 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:15 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:15 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 1073741824 Sep 09 03:57:15 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:16 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 1073741824" returned: 0 in 0.404s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:16 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 Sep 09 03:57:16 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:16 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429" returned: 0 in 0.253s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0156c0a-2433-4aaa-9ae2-72c524c7d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be83974c-e772-4f28-92da-3fabf8d99429', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da80c81-7313-48df-b538-45c25a7e3bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:16 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Volume volume-be83974c-e772-4f28-92da-3fabf8d99429 (be83974c-e772-4f28-92da-3fabf8d99429): created successfully Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da80c81-7313-48df-b538-45c25a7e3bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Flow 'volume_create_manager' (9e9e3cfc-17d0-42af-9e1c-57a8f01725bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-75425a86-06a0-4eda-856f-62bc835c206b tempest-ProjectReaderTests-1582153101 None] Created volume successfully. Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "cinder-be83974c-e772-4f28-92da-3fabf8d99429-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-be83974c-e772-4f28-92da-3fabf8d99429-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "cinder-quobyte-be83974c-e772-4f28-92da-3fabf8d99429" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-quobyte-be83974c-e772-4f28-92da-3fabf8d99429" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa968f2-e779-4554-86ae-c7f0f133d1a8]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:16 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 Sep 09 03:57:16 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:17 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429" returned: 0 in 0.351s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:17 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429 Sep 09 03:57:17 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:17 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be83974c-e772-4f28-92da-3fabf8d99429" returned: 0 in 0.241s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-quobyte-be83974c-e772-4f28-92da-3fabf8d99429" released by "delete_volume" :: held 0.629s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Created reservations ['13dd4931-c580-4924-8eb4-c13ff38513cc', '2b2653d1-37cf-42c0-a35a-e10b8e26fb03', '5ad1499d-a86d-4991-933b-7a1caf8b353d', '7d31066a-86c4-4c09-beeb-fd151908b6ef'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:17 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:17 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:17 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.242s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Deleted volume successfully. Sep 09 03:57:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-153b53e0-05bc-4c8d-877a-436c587ecd99 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-be83974c-e772-4f28-92da-3fabf8d99429-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Flow 'volume_create_manager' (e6517394-0a84-44e2-857b-2b41595ee933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8293249d-b664-4c5c-8555-1f4aeddecd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8293249d-b664-4c5c-8555-1f4aeddecd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162520098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9b49ef-6943-4a4d-8f4f-0d8e6744827e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d872bc53449c3a4aba709b730b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:18Z,use_quota=True,user_id='9b3c3526a02646959eb307924e6d6fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10376dd-60f9-44df-aa20-701a57910b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10376dd-60f9-44df-aa20-701a57910b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd793e4b-02f2-4df6-b847-c5d5c971bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd793e4b-02f2-4df6-b847-c5d5c971bce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9b49ef-6943-4a4d-8f4f-0d8e6744827e', 'volume_name': 'volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab89bc1-3c86-4c2b-ad28-5fe0b11992e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab89bc1-3c86-4c2b-ad28-5fe0b11992e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438da63f-a763-41e5-b80c-765c0ee326dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:18 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Volume ee9b49ef-6943-4a4d-8f4f-0d8e6744827e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e', 'volume_size': 1} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162520098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9b49ef-6943-4a4d-8f4f-0d8e6744827e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d872bc53449c3a4aba709b730b766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:18Z,use_quota=True,user_id='9b3c3526a02646959eb307924e6d6fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Creating volume ee9b49ef-6943-4a4d-8f4f-0d8e6744827e {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:18 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:18 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e 1073741824 Sep 09 03:57:18 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:18 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e 1073741824" returned: 0 in 0.416s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:18 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e Sep 09 03:57:18 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:19 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e" returned: 0 in 0.238s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438da63f-a763-41e5-b80c-765c0ee326dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b248a053-59f0-477c-b896-58a66cae0f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:19 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Volume volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e (ee9b49ef-6943-4a4d-8f4f-0d8e6744827e): created successfully Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b248a053-59f0-477c-b896-58a66cae0f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Flow 'volume_create_manager' (e6517394-0a84-44e2-857b-2b41595ee933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-350d99d6-0c38-4017-8306-18bd9a1672e5 tempest-ProjectReaderTests-1582153101 None] Created volume successfully. Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "cinder-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "cinder-quobyte-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-quobyte-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e" acquired by "delete_volume" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4274a9-8947-4f4c-9cad-c599b4647089]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:19 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e Sep 09 03:57:19 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:19 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e" returned: 0 in 0.344s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:19 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e Sep 09 03:57:19 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:19 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e" returned: 0 in 0.237s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-quobyte-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e" released by "delete_volume" :: held 0.621s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Created reservations ['39eb07c4-5d7d-43eb-94bb-3af3efd03898', '4d18dd4c-8f28-4557-a77d-d1fc73413778', '7deeef61-8150-437a-a88a-25d002f12766', '1c90e67c-215b-4eb3-a2cc-570e1ed38a0c'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:20 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:20 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:20 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.250s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:20 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Deleted volume successfully. Sep 09 03:57:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f13f169d-e33b-44f3-be2d-1717442d9019 tempest-ProjectReaderTests-1582153101 None] Lock "cinder-ee9b49ef-6943-4a4d-8f4f-0d8e6744827e-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:30 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:57:30 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=33,cinder:DELETE=5,cinder:SELECT=18,cinder:INSERT=7 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (e5252476-7e2d-4987-b0ba-50a9fc68f9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc7ca70-2ca9-40ea-b073-5c8b8de8b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc7ca70-2ca9-40ea-b073-5c8b8de8b48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1704183120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be443359-1dc4-4776-9f02-ff2d83aa5616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:33Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523bfa5c-b091-4fe3-bb3d-14aceb0c5a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523bfa5c-b091-4fe3-bb3d-14aceb0c5a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d38d04b-4af2-4cf4-9788-8be75927b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d38d04b-4af2-4cf4-9788-8be75927b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be443359-1dc4-4776-9f02-ff2d83aa5616', 'volume_name': 'volume-be443359-1dc4-4776-9f02-ff2d83aa5616', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8bb01f-d2d5-46b9-9e0f-527b35432d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8bb01f-d2d5-46b9-9e0f-527b35432d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4846b56e-9132-4367-aacd-501a1396d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Volume be443359-1dc4-4776-9f02-ff2d83aa5616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be443359-1dc4-4776-9f02-ff2d83aa5616', 'volume_size': 1} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1704183120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be443359-1dc4-4776-9f02-ff2d83aa5616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:33Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Creating volume be443359-1dc4-4776-9f02-ff2d83aa5616 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:32 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:32 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 1073741824 Sep 09 03:57:32 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (8d488e3d-775f-4f86-b11f-86083dc47047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7925dca-c942-4b3b-a3a6-96f93590997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7925dca-c942-4b3b-a3a6-96f93590997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665736265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb03ad46-4bc3-456f-a39d-0d87a0dff63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:33Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d3e829-1acb-4a31-9c8b-b13d5ee75a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d3e829-1acb-4a31-9c8b-b13d5ee75a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d50bb69-1694-47fd-8eda-ffd009d63105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d50bb69-1694-47fd-8eda-ffd009d63105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb03ad46-4bc3-456f-a39d-0d87a0dff63a', 'volume_name': 'volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48effef-a911-42d2-a080-135207ad927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48effef-a911-42d2-a080-135207ad927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7d7cd6-b7c8-4404-9696-d36ac110a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume fb03ad46-4bc3-456f-a39d-0d87a0dff63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a', 'volume_size': 1} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (95e38f15-e20a-46c8-bef5-b2850f972aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44dadc3-906a-4312-9ad5-e157476b26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44dadc3-906a-4312-9ad5-e157476b26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-105901138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ea081d-974a-405a-8b41-40112e8c5a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:33Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e45cce-1356-4f4e-a63e-9ea66da2e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e45cce-1356-4f4e-a63e-9ea66da2e866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86663b71-f22b-43d5-8d85-5ca8e9076696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86663b71-f22b-43d5-8d85-5ca8e9076696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ea081d-974a-405a-8b41-40112e8c5a78', 'volume_name': 'volume-57ea081d-974a-405a-8b41-40112e8c5a78', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3884f596-5f1c-4db1-8da4-d0e08eae3d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3884f596-5f1c-4db1-8da4-d0e08eae3d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8f55e1-b6d7-4b9e-a710-5e93605b53e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Volume 57ea081d-974a-405a-8b41-40112e8c5a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ea081d-974a-405a-8b41-40112e8c5a78', 'volume_size': 1} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (29377340-7163-47d5-b37e-705fd54c2607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2612c212-1333-4545-a4c9-250614254886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2612c212-1333-4545-a4c9-250614254886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1418617344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca6dc08-bc35-45d7-a227-ca0c3eedbad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:33Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96da2f2-2208-456e-8429-214c77894713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96da2f2-2208-456e-8429-214c77894713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fef66d6-a0f5-44c3-b233-7d0b5404243f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fef66d6-a0f5-44c3-b233-7d0b5404243f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca6dc08-bc35-45d7-a227-ca0c3eedbad3', 'volume_name': 'volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39efd4e-c876-403a-8454-ec1af028f3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39efd4e-c876-403a-8454-ec1af028f3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c268a441-156f-4d8f-b45b-62aa3d5ccb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume 5ca6dc08-bc35-45d7-a227-ca0c3eedbad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3', 'volume_size': 1} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:33 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 1073741824" returned: 0 in 0.777s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:33 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 Sep 09 03:57:33 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (c9aa4937-47a0-4da8-8896-0f0c72f9e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8736e562-a521-422d-9f6a-d72b5a2a8e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8736e562-a521-422d-9f6a-d72b5a2a8e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2016991364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd647b33-3e0b-4338-b8b3-05315c238a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:34Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ecbec1-0f75-4c7e-adad-460d981a2d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ecbec1-0f75-4c7e-adad-460d981a2d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc3fdd5-32aa-4c5c-afce-fba30bd04375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc3fdd5-32aa-4c5c-afce-fba30bd04375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd647b33-3e0b-4338-b8b3-05315c238a86', 'volume_name': 'volume-cd647b33-3e0b-4338-b8b3-05315c238a86', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37158dcd-ddc5-4d95-a3a2-20dbe756e33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37158dcd-ddc5-4d95-a3a2-20dbe756e33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6e9080-b40a-4940-a8fa-029e8ab06e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:33 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Volume cd647b33-3e0b-4338-b8b3-05315c238a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd647b33-3e0b-4338-b8b3-05315c238a86', 'volume_size': 1} Sep 09 03:57:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:34 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616" returned: 0 in 0.353s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665736265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb03ad46-4bc3-456f-a39d-0d87a0dff63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:33Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Creating volume fb03ad46-4bc3-456f-a39d-0d87a0dff63a {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:34 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4846b56e-9132-4367-aacd-501a1396d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be443359-1dc4-4776-9f02-ff2d83aa5616', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b640b264-dc55-4faf-bd6a-24d595dbdec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a 1073741824 Sep 09 03:57:34 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:34 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Volume volume-be443359-1dc4-4776-9f02-ff2d83aa5616 (be443359-1dc4-4776-9f02-ff2d83aa5616): created successfully Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b640b264-dc55-4faf-bd6a-24d595dbdec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (e5252476-7e2d-4987-b0ba-50a9fc68f9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:34 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-85aa01cb-9f58-4a55-9ad6-89c20366a8f3 tempest-CreateVolumesFromImageTest-117497559 None] Created volume successfully. Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (4bb60ef2-7a20-48dd-ab7d-2553822b0781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7b9959-17c9-4073-81de-4f9085c17145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7b9959-17c9-4073-81de-4f9085c17145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1616589082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f87fc0-4ac9-4f71-80e7-d84c4a5706f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:34Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c519ca3-cbe2-4d2a-bc4c-1c74d53b3d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c519ca3-cbe2-4d2a-bc4c-1c74d53b3d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e04b86-c4fb-468e-a75e-658b9a82e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e04b86-c4fb-468e-a75e-658b9a82e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f87fc0-4ac9-4f71-80e7-d84c4a5706f3', 'volume_name': 'volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bab71d-201f-42cb-ada2-acb14d293544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bab71d-201f-42cb-ada2-acb14d293544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3ffd33-6cc0-41d3-8545-b9915c5f09b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Volume 04f87fc0-4ac9-4f71-80e7-d84c4a5706f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3', 'volume_size': 1} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:34 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a 1073741824" returned: 0 in 0.628s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (40cf5018-be62-432c-b7a4-70953802d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d072b70-f13c-483c-918f-989bed58a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d072b70-f13c-483c-918f-989bed58a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1500552423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e844be5-1140-47ea-9e39-5fc41f339ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:35Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a325c6-aba0-41db-b057-d4c1754fb2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a325c6-aba0-41db-b057-d4c1754fb2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ce23d0-3618-40f3-953f-23c9373b618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ce23d0-3618-40f3-953f-23c9373b618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e844be5-1140-47ea-9e39-5fc41f339ef5', 'volume_name': 'volume-7e844be5-1140-47ea-9e39-5fc41f339ef5', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a3e378-8cef-4523-a651-275bb0a4d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a3e378-8cef-4523-a651-275bb0a4d49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11820bf3-aec3-4ed3-9e77-4bacbddd5522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:34 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Volume 7e844be5-1140-47ea-9e39-5fc41f339ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e844be5-1140-47ea-9e39-5fc41f339ef5', 'volume_size': 1} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:34 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a Sep 09 03:57:34 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:35 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" returned: 0 in 0.268s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-105901138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ea081d-974a-405a-8b41-40112e8c5a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:33Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Creating volume 57ea081d-974a-405a-8b41-40112e8c5a78 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:35 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7d7cd6-b7c8-4404-9696-d36ac110a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:35 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 1073741824 Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70a3198-6bb4-4ea4-91ad-9549adf12060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:35 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:35 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a (fb03ad46-4bc3-456f-a39d-0d87a0dff63a): created successfully Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70a3198-6bb4-4ea4-91ad-9549adf12060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (8d488e3d-775f-4f86-b11f-86083dc47047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6719ee2e-4b81-466a-9968-c58f0acebb05 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created volume successfully. Sep 09 03:57:35 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 1073741824" returned: 0 in 0.452s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:35 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 Sep 09 03:57:35 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:35 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78" returned: 0 in 0.260s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.212s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1418617344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca6dc08-bc35-45d7-a227-ca0c3eedbad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:33Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Creating volume 5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:35 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8f55e1-b6d7-4b9e-a710-5e93605b53e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ea081d-974a-405a-8b41-40112e8c5a78', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:35 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 1073741824 Sep 09 03:57:35 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5033b8fb-f511-4ca7-b46b-7ef0030f29e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:35 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Volume volume-57ea081d-974a-405a-8b41-40112e8c5a78 (57ea081d-974a-405a-8b41-40112e8c5a78): created successfully Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5033b8fb-f511-4ca7-b46b-7ef0030f29e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:35 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (95e38f15-e20a-46c8-bef5-b2850f972aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:35 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4c5b4bc3-eabb-4db1-a98a-fbbf269ababa tempest-CreateVolumesFromImageTest-117497559 None] Created volume successfully. Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:36 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 1073741824" returned: 0 in 0.544s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:36 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 Sep 09 03:57:36 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:36 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Flow 'volume_create_manager' (636923ae-c79b-4ca1-8a7a-4568849770e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff10428-8ecb-4330-bce0-dbf252fcfd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3" returned: 0 in 0.302s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.782s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2016991364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd647b33-3e0b-4338-b8b3-05315c238a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:34Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Creating volume cd647b33-3e0b-4338-b8b3-05315c238a86 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:36 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c268a441-156f-4d8f-b45b-62aa3d5ccb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:36 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 1073741824 Sep 09 03:57:36 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d614c48c-67d2-47c7-ae59-20252f6d0592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff10428-8ecb-4330-bce0-dbf252fcfd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6a5c8a-4a85-454d-a837-71f2a712e2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00ffa11de7e4f678b6d5d28dc9f8ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:37Z,use_quota=True,user_id='36e3d743769443ce84392df38e183635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5bc3eb4-bafa-4f97-98bb-2bc4984707bd),volume_type_id=e5bc3eb4-bafa-4f97-98bb-2bc4984707bd)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a5776c-a402-4fd4-8cea-40a23366c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a5776c-a402-4fd4-8cea-40a23366c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c9f848-de8b-4b75-87c6-3d6d86fdc8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:57:36 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 (5ca6dc08-bc35-45d7-a227-ca0c3eedbad3): created successfully Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d614c48c-67d2-47c7-ae59-20252f6d0592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:36 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (29377340-7163-47d5-b37e-705fd54c2607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:36 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cd8ca1ea-8639-48ec-bab9-424386fdab0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created volume successfully. Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c9f848-de8b-4b75-87c6-3d6d86fdc8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc6a5c8a-4a85-454d-a837-71f2a712e2c0', 'volume_name': 'volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0', 'volume_size': 1, 'image_id': 'c16291e3-7194-4904-acf6-eb00cc122551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c16291e3-7194-4904-acf6-eb00cc122551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c57abf21ef51dc266dc92a95f7402be1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b00ffa11de7e4f678b6d5d28dc9f8ad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5ab2e08204b2563a6224c0bbd0d509079aa776f89bcfcf10253526efcc612782583614b593d72efe5abf61d3f8013735f1a53d39b92af4f16452aa3cc991a34', 'id': 'c16291e3-7194-4904-acf6-eb00cc122551', 'created_at': datetime.datetime(2026, 9, 9, 1, 57, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 57, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c16291e3-7194-4904-acf6-eb00cc122551/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758909c3-63ba-4f32-a7e5-b3a7be129638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758909c3-63ba-4f32-a7e5-b3a7be129638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5e28b5-1a48-4528-8fe6-f1d4e2332895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Volume dc6a5c8a-4a85-454d-a837-71f2a712e2c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0', 'volume_size': 1, 'image_id': 'c16291e3-7194-4904-acf6-eb00cc122551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c16291e3-7194-4904-acf6-eb00cc122551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c57abf21ef51dc266dc92a95f7402be1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b00ffa11de7e4f678b6d5d28dc9f8ad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5ab2e08204b2563a6224c0bbd0d509079aa776f89bcfcf10253526efcc612782583614b593d72efe5abf61d3f8013735f1a53d39b92af4f16452aa3cc991a34', 'id': 'c16291e3-7194-4904-acf6-eb00cc122551', 'created_at': datetime.datetime(2026, 9, 9, 1, 57, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 57, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c16291e3-7194-4904-acf6-eb00cc122551/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Trying to clone dc6a5c8a-4a85-454d-a837-71f2a712e2c0 from image c16291e3-7194-4904-acf6-eb00cc122551 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c16291e3-7194-4904-acf6-eb00cc122551', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:57:37 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Image download 0.00 MB at 0.00 MB/s Sep 09 03:57:37 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 1073741824" returned: 0 in 0.449s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[417d85c8-a6bd-483a-88a2-b965232c1551]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:37 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 Sep 09 03:57:37 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:37 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD Sep 09 03:57:37 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:37 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:37 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:37 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:37 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86" returned: 0 in 0.291s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.145s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1616589082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f87fc0-4ac9-4f71-80e7-d84c4a5706f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:34Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Creating volume 04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:37 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:37 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 1073741824 Sep 09 03:57:37 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6e9080-b40a-4940-a8fa-029e8ab06e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd647b33-3e0b-4338-b8b3-05315c238a86', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780b998a-9c9a-418f-8921-f633f5ea9d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Volume volume-cd647b33-3e0b-4338-b8b3-05315c238a86 (cd647b33-3e0b-4338-b8b3-05315c238a86): created successfully Sep 09 03:57:37 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780b998a-9c9a-418f-8921-f633f5ea9d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (c9aa4937-47a0-4da8-8896-0f0c72f9e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.307s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:37 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0ea68688-bbd7-4560-b3a1-5afc1f54af1c tempest-CreateVolumesFromImageTest-117497559 None] Created volume successfully. Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:57:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:57:37 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD Sep 09 03:57:37 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:38 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD" returned: 1 in 0.449s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Temporary image c16291e3-7194-4904-acf6-eb00cc122551 is fetched for user 36e3d743769443ce84392df38e183635. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[501e1d2a-ebff-461b-877c-e2ffd819d448]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:38 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 1073741824" returned: 0 in 0.631s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:38 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD Sep 09 03:57:38 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:38 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 Sep 09 03:57:38 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (34f28091-4b2b-4663-ac35-fe1da13a4342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8deaff1-34ef-4208-a236-6b4ee45c2e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8deaff1-34ef-4208-a236-6b4ee45c2e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643894671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57854e19-3d7c-4c7b-89c8-346e5e262b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:38Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a765ddff-32eb-4eae-8e93-8b3ac17e1a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a765ddff-32eb-4eae-8e93-8b3ac17e1a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da068d3-cc48-4b2a-aaa7-afef22e3632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da068d3-cc48-4b2a-aaa7-afef22e3632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57854e19-3d7c-4c7b-89c8-346e5e262b02', 'volume_name': 'volume-57854e19-3d7c-4c7b-89c8-346e5e262b02', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7c9348-17aa-45a9-97cc-f25716c40aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7c9348-17aa-45a9-97cc-f25716c40aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523d5a81-ce01-4b05-b067-8f350cd4d03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume 57854e19-3d7c-4c7b-89c8-346e5e262b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57854e19-3d7c-4c7b-89c8-346e5e262b02', 'volume_size': 1} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:38 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:38 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3" returned: 0 in 0.381s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.838s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1500552423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e844be5-1140-47ea-9e39-5fc41f339ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6257094ae7bc483a8627de73cfaee8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:35Z,use_quota=True,user_id='707f022d7cef471796e3669f1e6164b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Creating volume 7e844be5-1140-47ea-9e39-5fc41f339ef5 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:38 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3ffd33-6cc0-41d3-8545-b9915c5f09b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 1073741824 Sep 09 03:57:38 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632aee7c-bbe9-49ef-b1e1-70ccc56f5046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Volume volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 (04f87fc0-4ac9-4f71-80e7-d84c4a5706f3): created successfully Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632aee7c-bbe9-49ef-b1e1-70ccc56f5046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (4bb60ef2-7a20-48dd-ab7d-2553822b0781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:38 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9ebee6d2-a029-4dd5-afd9-69048cc9f34d tempest-CreateVolumesFromImageTest-117497559 None] Created volume successfully. Sep 09 03:57:38 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD Sep 09 03:57:38 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (a90b7f0b-ba6c-4134-904b-38d77886f62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d020d2c-718b-41cc-8c25-f12070fa8406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d020d2c-718b-41cc-8c25-f12070fa8406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1702058716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789a6573-c0cd-41f0-aca4-68d86f70d376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:39Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dc9c39-d832-4625-ab8c-4de284c588b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dc9c39-d832-4625-ab8c-4de284c588b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c121a9da-8925-4c9f-841c-3a7e8417612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c121a9da-8925-4c9f-841c-3a7e8417612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789a6573-c0cd-41f0-aca4-68d86f70d376', 'volume_name': 'volume-789a6573-c0cd-41f0-aca4-68d86f70d376', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ede50b-7cb2-49a4-92cf-7517477d3cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ede50b-7cb2-49a4-92cf-7517477d3cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445d1b99-eceb-45ee-b85f-18a852b7e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume 789a6573-c0cd-41f0-aca4-68d86f70d376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789a6573-c0cd-41f0-aca4-68d86f70d376', 'volume_size': 1} Sep 09 03:57:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:39 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD" returned: 1 in 0.437s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:39 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 1073741824" returned: 0 in 0.524s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:39 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 Sep 09 03:57:39 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (9b77de7c-8b6b-46a0-8da8-7ae0d8721c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a130cce4-c988-4588-97f9-1670a622d2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a130cce4-c988-4588-97f9-1670a622d2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700356587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc7a25d-5dd4-4e11-b8c3-71b965ab592f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:39Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba23aaa0-87a8-4514-b3cf-029a9dcf8000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba23aaa0-87a8-4514-b3cf-029a9dcf8000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacca000-2e80-4262-8e27-1e440beeb6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacca000-2e80-4262-8e27-1e440beeb6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc7a25d-5dd4-4e11-b8c3-71b965ab592f', 'volume_name': 'volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101312ce-1a6f-44f7-86af-0b5652531cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101312ce-1a6f-44f7-86af-0b5652531cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692f7cd5-f330-4b65-8080-772db603988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume 9bc7a25d-5dd4-4e11-b8c3-71b965ab592f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f', 'volume_size': 1} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:39 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5" returned: 0 in 0.290s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.164s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11820bf3-aec3-4ed3-9e77-4bacbddd5522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e844be5-1140-47ea-9e39-5fc41f339ef5', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febd43cf-d2c5-45dd-aed6-760ba4a779e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Creating offline snapshot 0e510131-b38c-4012-bc02-39bb8d41149a of volume fb03ad46-4bc3-456f-a39d-0d87a0dff63a {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:57:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Volume volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 (7e844be5-1140-47ea-9e39-5fc41f339ef5): created successfully Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febd43cf-d2c5-45dd-aed6-760ba4a779e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Flow 'volume_create_manager' (40cf5018-be62-432c-b7a4-70953802d411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1def8c-6ac5-4051-851e-eb931723b8f6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a6112294-b78c-4b58-84d1-3eb059390be1 tempest-CreateVolumesFromImageTest-117497559 None] Created volume successfully. Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (ccf4ea55-ae5d-438e-9557-638291910e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:39 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a Sep 09 03:57:39 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be5f416-800b-4f46-aa30-d943852cbb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be5f416-800b-4f46-aa30-d943852cbb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795762552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2507fc6-f2c1-4daf-ad29-94fb56d7b246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:40Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13df36a-5a74-4f74-a350-4651c3680605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13df36a-5a74-4f74-a350-4651c3680605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d088445-db44-4519-91fd-64a230bd56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d088445-db44-4519-91fd-64a230bd56db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2507fc6-f2c1-4daf-ad29-94fb56d7b246', 'volume_name': 'volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d1ee1a-8964-4517-8c5c-6da55dea8c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d1ee1a-8964-4517-8c5c-6da55dea8c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be85739-7f80-4385-a912-2529b010a43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:39 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume a2507fc6-f2c1-4daf-ad29-94fb56d7b246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246', 'volume_size': 1} Sep 09 03:57:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:40 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" returned: 0 in 0.403s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:40 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a 1G Sep 09 03:57:40 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (0cb3e3c5-aac6-4cbe-854e-e28a33be471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c09619b-c285-4b07-b65a-82a917891e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c09619b-c285-4b07-b65a-82a917891e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-287324557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dce1a7-573a-4156-bc32-acc4fa20503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:40Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3c9908-e4f2-4759-98d4-f9142a4b4a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3c9908-e4f2-4759-98d4-f9142a4b4a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd6b437-76a6-4807-b65e-04d2c674027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd6b437-76a6-4807-b65e-04d2c674027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53dce1a7-573a-4156-bc32-acc4fa20503e', 'volume_name': 'volume-53dce1a7-573a-4156-bc32-acc4fa20503e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3782e573-cace-4813-8bc5-6a106e9da5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3782e573-cace-4813-8bc5-6a106e9da5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2183a7a8-05d8-4188-b3b3-e85c77d309c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:40 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume 53dce1a7-573a-4156-bc32-acc4fa20503e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53dce1a7-573a-4156-bc32-acc4fa20503e', 'volume_size': 1} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:40 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a 1G" returned: 0 in 0.377s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:40 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a Sep 09 03:57:40 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-7e844be5-1140-47ea-9e39-5fc41f339ef5-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:40 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a" returned: 0 in 0.293s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:40 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a is being set with open permissions: ugo+rw Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-7e844be5-1140-47ea-9e39-5fc41f339ef5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:40 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a Sep 09 03:57:40 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-quobyte-7e844be5-1140-47ea-9e39-5fc41f339ef5" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-7e844be5-1140-47ea-9e39-5fc41f339ef5" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f8ce87-356a-4c2b-a60e-9bd8a49bfc65]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:40 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 Sep 09 03:57:40 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:40 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a" returned: 0 in 0.264s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:41 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.info Sep 09 03:57:41 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:41 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5" returned: 0 in 0.363s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:41 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5 Sep 09 03:57:41 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:41 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.info" returned: 0 in 0.246s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:41 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.info is being set with open permissions: ugo+rw Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:41 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.info Sep 09 03:57:41 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:41 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-7e844be5-1140-47ea-9e39-5fc41f339ef5" returned: 0 in 0.253s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-7e844be5-1140-47ea-9e39-5fc41f339ef5" released by "delete_volume" :: held 0.665s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Created reservations ['8d89d077-8b66-4fef-a4c1-b9ebadbfb09b', '3b6f5186-bc54-4615-af94-497114060134', '58ad3182-f049-4501-adfe-552134504c5f', '6170b0f1-e00d-4723-8c6a-451b571f1b4d'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:41 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.info" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.994s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643894671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57854e19-3d7c-4c7b-89c8-346e5e262b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:38Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Creating volume 57854e19-3d7c-4c7b-89c8-346e5e262b02 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:41 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:41 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 1073741824 Sep 09 03:57:41 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c129377b-77e0-4f83-9f12-06614e7a4264 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Create snapshot completed successfully Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:41 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:41 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:41 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.267s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Deleted volume successfully. Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096580f2-95d9-4419-a6b4-699fac932ce2 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-7e844be5-1140-47ea-9e39-5fc41f339ef5-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-quobyte-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3" acquired by "delete_volume" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc29be19-4192-4e7b-9de1-5356ac18ad1c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:42 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 1073741824" returned: 0 in 0.570s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:42 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 Sep 09 03:57:42 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:42 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 Sep 09 03:57:42 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:42 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3" returned: 0 in 0.388s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:42 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02" returned: 0 in 0.270s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:42 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3 Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.456s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:42 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1702058716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789a6573-c0cd-41f0-aca4-68d86f70d376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:39Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Creating volume 789a6573-c0cd-41f0-aca4-68d86f70d376 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:42 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523d5a81-ce01-4b05-b067-8f350cd4d03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57854e19-3d7c-4c7b-89c8-346e5e262b02', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:42 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 1073741824 Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531e2410-0c84-400d-86dd-644f2b65ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:42 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:42 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 (57854e19-3d7c-4c7b-89c8-346e5e262b02): created successfully Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531e2410-0c84-400d-86dd-644f2b65ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (34f28091-4b2b-4663-ac35-fe1da13a4342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b5fe28a1-b7f2-4525-8b46-e627e78c03ff tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created volume successfully. Sep 09 03:57:42 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3" returned: 0 in 0.259s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3" released by "delete_volume" :: held 0.693s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Created reservations ['3c552522-718e-495d-894d-7724db9c33b5', 'f7c3e09f-7da9-4493-9156-7c12f118a173', '4e2f853a-b127-4d53-a27b-e619d4f8f0c4', '4e098d8e-58b7-48b0-b57a-51ff913b0d74'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:42 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:42 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:42 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 1073741824" returned: 0 in 0.477s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:42 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 Sep 09 03:57:42 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-cd647b33-3e0b-4338-b8b3-05315c238a86-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-cd647b33-3e0b-4338-b8b3-05315c238a86-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:43 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.351s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Deleted volume successfully. Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-quobyte-cd647b33-3e0b-4338-b8b3-05315c238a86" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e6ad3be9-3bb2-4cc8-a58c-cdf153a9c339 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-04f87fc0-4ac9-4f71-80e7-d84c4a5706f3-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-cd647b33-3e0b-4338-b8b3-05315c238a86" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:43 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376" returned: 0 in 0.314s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bea175-b498-4dd0-bc13-95093c355331]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.231s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6a5c8a-4a85-454d-a837-71f2a712e2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00ffa11de7e4f678b6d5d28dc9f8ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:37Z,use_quota=True,user_id='36e3d743769443ce84392df38e183635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5bc3eb4-bafa-4f97-98bb-2bc4984707bd),volume_type_id=e5bc3eb4-bafa-4f97-98bb-2bc4984707bd)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Creating volume dc6a5c8a-4a85-454d-a837-71f2a712e2c0 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:43 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:43 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 1073741824 Sep 09 03:57:43 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445d1b99-eceb-45ee-b85f-18a852b7e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789a6573-c0cd-41f0-aca4-68d86f70d376', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c79c4f9-6b26-4aa8-903f-49f78e26c5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume volume-789a6573-c0cd-41f0-aca4-68d86f70d376 (789a6573-c0cd-41f0-aca4-68d86f70d376): created successfully Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c79c4f9-6b26-4aa8-903f-49f78e26c5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (a90b7f0b-ba6c-4134-904b-38d77886f62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (bc4dc592-e70f-4c42-9aac-3d025376eed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f115e5-8292-4d9a-bd15-2fbe9839cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-7cb1c208-d2bd-4945-aa13-307c5feddda7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created volume successfully. Sep 09 03:57:43 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 Sep 09 03:57:43 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f115e5-8292-4d9a-bd15-2fbe9839cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1947005151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41dd1c4-f909-4e58-93b7-92f8b1904dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:43Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13276c3-a60d-4387-b3cc-92021b69cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13276c3-a60d-4387-b3cc-92021b69cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7ccd8d-1a5f-4779-8abb-d9cbb33f8e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7ccd8d-1a5f-4779-8abb-d9cbb33f8e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41dd1c4-f909-4e58-93b7-92f8b1904dd4', 'volume_name': 'volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182cb2c1-cc29-4b7d-b15a-fa30e7fdec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182cb2c1-cc29-4b7d-b15a-fa30e7fdec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4598757d-c81e-422b-a17f-06d8a1b4c432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume a41dd1c4-f909-4e58-93b7-92f8b1904dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4', 'volume_size': 1} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:43 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86" returned: 0 in 0.448s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:43 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86 Sep 09 03:57:43 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:43 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (d4cb6df6-381a-401c-af1b-80f07a374ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9305d5d3-05b7-4cdd-91d8-14233b15ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 1073741824" returned: 0 in 0.567s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9305d5d3-05b7-4cdd-91d8-14233b15ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006052326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1631b617-591b-4071-8868-cda3240f4689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:44Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627b366d-81e3-404d-a023-2a709d22c507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627b366d-81e3-404d-a023-2a709d22c507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8c91ff-98ed-410b-945e-1be76964369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8c91ff-98ed-410b-945e-1be76964369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1631b617-591b-4071-8868-cda3240f4689', 'volume_name': 'volume-1631b617-591b-4071-8868-cda3240f4689', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e180f3bd-5e9f-402c-9c8f-0b9d8290bcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e180f3bd-5e9f-402c-9c8f-0b9d8290bcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1389cd4-c26b-43cf-bbd6-5859050b2a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:43 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume 1631b617-591b-4071-8868-cda3240f4689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1631b617-591b-4071-8868-cda3240f4689', 'volume_size': 1} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:43 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 Sep 09 03:57:43 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:44 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cd647b33-3e0b-4338-b8b3-05315c238a86" returned: 0 in 0.395s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-cd647b33-3e0b-4338-b8b3-05315c238a86" released by "delete_volume" :: held 0.958s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Created reservations ['53317756-bfdf-4a8d-9aa5-64b1d7aed1d0', 'd5360b2a-4e5d-440e-96a4-6e21688f78e7', '6e3d9bcf-df29-4a00-bf12-299b5910c7c1', '4f612508-774c-4e0e-a8cb-1e1cdc101266'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:44 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0" returned: 0 in 0.350s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.909s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700356587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc7a25d-5dd4-4e11-b8c3-71b965ab592f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:39Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Creating volume 9bc7a25d-5dd4-4e11-b8c3-71b965ab592f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:44 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:44 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f 1073741824 Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:44 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (89bbb161-2fbe-4f1f-b85e-92015d4eba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa039508-8d91-463b-ac96-1642d20544b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Attempting download of c16291e3-7194-4904-acf6-eb00cc122551 ((None, [{'url': 'file:///opt/stack/data/glance/images/c16291e3-7194-4904-acf6-eb00cc122551', 'metadata': {}}])) to volume dc6a5c8a-4a85-454d-a837-71f2a712e2c0. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-57ea081d-974a-405a-8b41-40112e8c5a78-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa039508-8d91-463b-ac96-1642d20544b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1388292043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e4518b-54b5-4701-ba09-8f872ce28570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:44Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181ea39-5029-4c8c-bd95-308dec8e29a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181ea39-5029-4c8c-bd95-308dec8e29a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cbb60fa-d632-4afa-a745-bade9f814e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cbb60fa-d632-4afa-a745-bade9f814e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e4518b-54b5-4701-ba09-8f872ce28570', 'volume_name': 'volume-90e4518b-54b5-4701-ba09-8f872ce28570', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ab0e48-77de-400a-9444-6521b6f17730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ab0e48-77de-400a-9444-6521b6f17730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c924ffe-8863-4ccc-9169-b7aa480cf3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:44 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume 90e4518b-54b5-4701-ba09-8f872ce28570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e4518b-54b5-4701-ba09-8f872ce28570', 'volume_size': 1} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-57ea081d-974a-405a-8b41-40112e8c5a78-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:44 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:44 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f33e34c-a889-42ea-896f-1bd3c2db8c7b]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c16291e3-7194-4904-acf6-eb00cc122551_36hmpc23 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-quobyte-57ea081d-974a-405a-8b41-40112e8c5a78" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-57ea081d-974a-405a-8b41-40112e8c5a78" acquired by "delete_volume" :: waited 0.055s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[997b96d3-0ff0-483f-9fc0-f1e07019a91b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:44 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c16291e3-7194-4904-acf6-eb00cc122551_36hmpc23 Sep 09 03:57:44 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:44 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 Sep 09 03:57:44 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:45 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:45 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f 1073741824" returned: 0 in 0.809s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.606s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Deleted volume successfully. Sep 09 03:57:45 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (caae48ec-c96f-4dd4-9795-d71b9a8c6eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff941cc-aae5-4bda-9c20-2bd81acc2a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c16291e3-7194-4904-acf6-eb00cc122551_36hmpc23" returned: 0 in 0.612s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c16291e3-7194-4904-acf6-eb00cc122551_36hmpc23 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f275c226-ca78-4a66-b582-d3a5fd6d7451 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-cd647b33-3e0b-4338-b8b3-05315c238a86-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff941cc-aae5-4bda-9c20-2bd81acc2a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836343273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23c0069-ae25-40aa-bb8e-02d3770ce512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:45Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27721dd-131e-4aa3-83e8-23ce8a60773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27721dd-131e-4aa3-83e8-23ce8a60773d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e8d488-21e2-4a93-ba25-23accadf5d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e8d488-21e2-4a93-ba25-23accadf5d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23c0069-ae25-40aa-bb8e-02d3770ce512', 'volume_name': 'volume-f23c0069-ae25-40aa-bb8e-02d3770ce512', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f Sep 09 03:57:45 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbfee29-4188-49a9-ab90-7e1262b2915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbfee29-4188-49a9-ab90-7e1262b2915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8285346b-38b4-4414-9fa1-1169d0d4a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume f23c0069-ae25-40aa-bb8e-02d3770ce512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23c0069-ae25-40aa-bb8e-02d3770ce512', 'volume_size': 1} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:45 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78" returned: 0 in 0.644s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:45 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c16291e3-7194-4904-acf6-eb00cc122551_36hmpc23 Sep 09 03:57:45 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:45 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78 Sep 09 03:57:45 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (9f48040a-f975-4fa9-9e01-8beb424660b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaea8d44-cc8e-4d9d-91a4-c05517a2c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaea8d44-cc8e-4d9d-91a4-c05517a2c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357205510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33c3aa4-ea0f-46aa-a0e3-ed359021fc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:45Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb119ea-9083-4e9c-a0b1-e459f96bcd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb119ea-9083-4e9c-a0b1-e459f96bcd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb442bfb-47f0-4ef7-9d9a-75e99b07c879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb442bfb-47f0-4ef7-9d9a-75e99b07c879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33c3aa4-ea0f-46aa-a0e3-ed359021fc82', 'volume_name': 'volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca0e8d5-8ddc-429e-ab2d-d0549e7eb204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca0e8d5-8ddc-429e-ab2d-d0549e7eb204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452cce25-f8b2-4c00-a5d3-1387af529b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume c33c3aa4-ea0f-46aa-a0e3-ed359021fc82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82', 'volume_size': 1} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:45 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f" returned: 0 in 0.320s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.793s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795762552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2507fc6-f2c1-4daf-ad29-94fb56d7b246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:40Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Creating volume a2507fc6-f2c1-4daf-ad29-94fb56d7b246 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:45 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692f7cd5-f330-4b65-8080-772db603988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc31d5bb-e057-4268-810d-eed88fddd0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:45 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 1073741824 Sep 09 03:57:45 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:45 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f (9bc7a25d-5dd4-4e11-b8c3-71b965ab592f): created successfully Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc31d5bb-e057-4268-810d-eed88fddd0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:45 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (9b77de7c-8b6b-46a0-8da8-7ae0d8721c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c16291e3-7194-4904-acf6-eb00cc122551_36hmpc23" returned: 1 in 0.456s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c16291e3-7194-4904-acf6-eb00cc122551_36hmpc23' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a3614c-9b89-45b8-afb1-0aa8f862e866]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:45 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57ea081d-974a-405a-8b41-40112e8c5a78" returned: 0 in 0.291s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1f85d296-8a59-4c98-8a6f-7c32a1bdbc0f tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created volume successfully. Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-57ea081d-974a-405a-8b41-40112e8c5a78" released by "delete_volume" :: held 1.019s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Created reservations ['f578dc20-8bcb-4ef1-b590-ddce92c66dd2', '45fdb3e2-ea51-4cae-8615-beeb2e822940', '6f73b304-a1c6-4fd1-8ad9-7f5b2ee94cc2', '10c98532-fee4-4b5b-b9bc-48fa1bb7aa7d'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:45 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD Sep 09 03:57:45 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:45 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:45 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:46 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 1073741824" returned: 0 in 0.510s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:46 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:46 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.284s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Deleted volume successfully. Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ea81a579-361c-4b4f-994e-d25c3ebe6eb8 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-57ea081d-974a-405a-8b41-40112e8c5a78-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:46 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 Sep 09 03:57:46 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:46 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD Sep 09 03:57:46 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:46 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246" returned: 0 in 0.257s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.300s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-287324557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dce1a7-573a-4156-bc32-acc4fa20503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56396028b0a64655be7bf14e2648d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:40Z,use_quota=True,user_id='aba4fdf330434ade8665c60f71b40586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Creating volume 53dce1a7-573a-4156-bc32-acc4fa20503e {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:46 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:46 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] c16291e3-7194-4904-acf6-eb00cc122551 was raw, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:46 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e 1073741824 Sep 09 03:57:46 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be85739-7f80-4385-a912-2529b010a43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea4e786-05a1-425c-9e69-495c8ae4f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:46 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 Sep 09 03:57:46 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:46 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 (a2507fc6-f2c1-4daf-ad29-94fb56d7b246): created successfully Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea4e786-05a1-425c-9e69-495c8ae4f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (ccf4ea55-ae5d-438e-9557-638291910e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ca2159da-a35e-4a28-bb62-69608b5e75a7 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created volume successfully. Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-be443359-1dc4-4776-9f02-ff2d83aa5616-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-be443359-1dc4-4776-9f02-ff2d83aa5616-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "cinder-quobyte-be443359-1dc4-4776-9f02-ff2d83aa5616" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-be443359-1dc4-4776-9f02-ff2d83aa5616" acquired by "delete_volume" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[604cb362-2d62-4976-891a-6eb69c9b34af]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:46 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e 1073741824" returned: 0 in 0.508s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:47 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:47 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e Sep 09 03:57:47 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0" returned: 0 in 0.566s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c16291e3-7194-4904-acf6-eb00cc122551_c1j3xxyndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:57:47 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:47 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 Sep 09 03:57:47 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:47 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 1G Sep 09 03:57:47 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:47 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.803s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1947005151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41dd1c4-f909-4e58-93b7-92f8b1904dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:43Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Creating volume a41dd1c4-f909-4e58-93b7-92f8b1904dd4 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:47 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:47 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 1073741824 Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2183a7a8-05d8-4188-b3b3-e85c77d309c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53dce1a7-573a-4156-bc32-acc4fa20503e', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:47 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c90209b-ffe4-4b95-bfbe-c910d853772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Volume volume-53dce1a7-573a-4156-bc32-acc4fa20503e (53dce1a7-573a-4156-bc32-acc4fa20503e): created successfully Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c90209b-ffe4-4b95-bfbe-c910d853772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:47 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Flow 'volume_create_manager' (0cb3e3c5-aac6-4cbe-854e-e28a33be471b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616" returned: 0 in 0.434s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:47 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-75a27ac1-acfd-4b99-a4a2-833b91e20273 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created volume successfully. Sep 09 03:57:47 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616 Sep 09 03:57:47 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:47 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 1G" returned: 0 in 0.379s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Downloaded image c16291e3-7194-4904-acf6-eb00cc122551 ((None, [{'url': 'file:///opt/stack/data/glance/images/c16291e3-7194-4904-acf6-eb00cc122551', 'metadata': {}}])) to volume dc6a5c8a-4a85-454d-a837-71f2a712e2c0 successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Temporary image c16291e3-7194-4904-acf6-eb00cc122551 for user 36e3d743769443ce84392df38e183635 is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Marking volume dc6a5c8a-4a85-454d-a837-71f2a712e2c0 as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Copying metadata from image c16291e3-7194-4904-acf6-eb00cc122551 to dc6a5c8a-4a85-454d-a837-71f2a712e2c0. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Creating volume glance metadata for volume dc6a5c8a-4a85-454d-a837-71f2a712e2c0 backed by image c16291e3-7194-4904-acf6-eb00cc122551 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c16291e3-7194-4904-acf6-eb00cc122551', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c57abf21ef51dc266dc92a95f7402be1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5e28b5-1a48-4528-8fe6-f1d4e2332895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0', 'volume_size': 1, 'image_id': 'c16291e3-7194-4904-acf6-eb00cc122551', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c16291e3-7194-4904-acf6-eb00cc122551', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c57abf21ef51dc266dc92a95f7402be1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b00ffa11de7e4f678b6d5d28dc9f8ad1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5ab2e08204b2563a6224c0bbd0d509079aa776f89bcfcf10253526efcc612782583614b593d72efe5abf61d3f8013735f1a53d39b92af4f16452aa3cc991a34', 'id': 'c16291e3-7194-4904-acf6-eb00cc122551', 'created_at': datetime.datetime(2026, 9, 9, 1, 57, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 57, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c16291e3-7194-4904-acf6-eb00cc122551/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23a6a8e-e4a7-409c-9e42-ffc6c6c4c629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Volume volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 (dc6a5c8a-4a85-454d-a837-71f2a712e2c0): created successfully Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23a6a8e-e4a7-409c-9e42-ffc6c6c4c629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Flow 'volume_create_manager' (636923ae-c79b-4ca1-8a7a-4568849770e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:47 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8b42e3ce-2d58-4052-b427-1fcf5094ea15 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Created volume successfully. Sep 09 03:57:47 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-be443359-1dc4-4776-9f02-ff2d83aa5616" returned: 0 in 0.297s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-quobyte-be443359-1dc4-4776-9f02-ff2d83aa5616" released by "delete_volume" :: held 0.774s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Created reservations ['7378afa4-8cf7-4d7c-9471-3ab2dfde961f', '8e0bf663-b4ed-4c67-8228-2e4a41e49d29', '8c493629-b4b1-4c8e-8bf6-a911a36fdd11', '939b731d-b27d-4680-b950-f20d616a7537'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:47 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 1073741824" returned: 0 in 0.495s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:47 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:47 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:47 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 Sep 09 03:57:47 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:48 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.269s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:48 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4" returned: 0 in 0.261s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Deleted volume successfully. Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.212s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006052326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1631b617-591b-4071-8868-cda3240f4689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:44Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Creating volume 1631b617-591b-4071-8868-cda3240f4689 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:48 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4598757d-c81e-422b-a17f-06d8a1b4c432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:48 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 1073741824 Sep 09 03:57:48 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b06a84d-2a28-4087-8852-8cbd47d05de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-4181eaf9-b12b-42ec-bc56-feb4bb9aea17 tempest-CreateVolumesFromImageTest-117497559 None] Lock "cinder-be443359-1dc4-4776-9f02-ff2d83aa5616-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:48 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 (a41dd1c4-f909-4e58-93b7-92f8b1904dd4): created successfully Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b06a84d-2a28-4087-8852-8cbd47d05de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (bc4dc592-e70f-4c42-9aac-3d025376eed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-53dce1a7-573a-4156-bc32-acc4fa20503e-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fd09de47-19e4-424d-b387-a4493dfc41cf tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created volume successfully. Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-53dce1a7-573a-4156-bc32-acc4fa20503e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-quobyte-53dce1a7-573a-4156-bc32-acc4fa20503e" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-53dce1a7-573a-4156-bc32-acc4fa20503e" acquired by "delete_volume" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a0d29-3f54-4ede-aa04-abafa0e91efa]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:48 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e Sep 09 03:57:48 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:48 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 1073741824" returned: 0 in 0.564s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:48 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Acquiring lock "cinder-dc6a5c8a-4a85-454d-a837-71f2a712e2c0-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:48 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 Sep 09 03:57:48 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e" returned: 0 in 0.439s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "cinder-dc6a5c8a-4a85-454d-a837-71f2a712e2c0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:48 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e Sep 09 03:57:48 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Acquiring lock "cinder-quobyte-dc6a5c8a-4a85-454d-a837-71f2a712e2c0" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "cinder-quobyte-dc6a5c8a-4a85-454d-a837-71f2a712e2c0" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d01f64-03b1-45d3-bd22-ba45b05326dc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:49 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689" returned: 0 in 0.343s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.582s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1388292043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e4518b-54b5-4701-ba09-8f872ce28570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:44Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Creating volume 90e4518b-54b5-4701-ba09-8f872ce28570 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:49 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:49 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 Sep 09 03:57:49 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1389cd4-c26b-43cf-bbd6-5859050b2a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1631b617-591b-4071-8868-cda3240f4689', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1468da-4e64-41d3-aa1e-7f0a145571a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:49 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:49 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 1073741824 Sep 09 03:57:49 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-53dce1a7-573a-4156-bc32-acc4fa20503e" returned: 0 in 0.354s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:49 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume volume-1631b617-591b-4071-8868-cda3240f4689 (1631b617-591b-4071-8868-cda3240f4689): created successfully Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1468da-4e64-41d3-aa1e-7f0a145571a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (d4cb6df6-381a-401c-af1b-80f07a374ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-53dce1a7-573a-4156-bc32-acc4fa20503e" released by "delete_volume" :: held 0.872s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-359aa229-aefe-478c-ad3b-7b7766fe1e04 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created volume successfully. Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created reservations ['74105edb-0de5-4807-8064-eba2fbf0db09', '8c44ecd1-2eed-43dc-91a6-91ea5c2daf29', '8edf416e-2f7a-49fe-a95f-f9b9c27d2d23', '7ef66fce-48d1-44a7-885a-2787484be703'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:49 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:49 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:49 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0" returned: 0 in 0.554s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-a2507fc6-f2c1-4daf-ad29-94fb56d7b246-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:49 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0 Sep 09 03:57:49 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-a2507fc6-f2c1-4daf-ad29-94fb56d7b246-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-quobyte-a2507fc6-f2c1-4daf-ad29-94fb56d7b246" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-a2507fc6-f2c1-4daf-ad29-94fb56d7b246" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e626ee-e743-448b-93f9-5e31d9882d48]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:49 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:49 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.483s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:49 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-dc6a5c8a-4a85-454d-a837-71f2a712e2c0" returned: 0 in 0.369s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 1073741824" returned: 0 in 0.768s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Deleted volume successfully. Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "cinder-quobyte-dc6a5c8a-4a85-454d-a837-71f2a712e2c0" released by "delete_volume" :: held 1.015s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1a7a1741-72ce-4712-9a54-cd64d6663930 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-53dce1a7-573a-4156-bc32-acc4fa20503e-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:49 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 Sep 09 03:57:49 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:50 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 Sep 09 03:57:50 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Created reservations ['462ddde0-585e-4d2d-a413-1c1b25f1d445', 'f7c8f64c-1e14-4b78-9a02-2956bf5b57aa', 'f4d3d10b-91bf-4c2e-9874-ee1bc9fb03c1', '8e2286ad-52b1-4ba5-a921-dccfa5ee19b2'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:50 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:50 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:50 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246" returned: 0 in 0.469s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:50 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246 Sep 09 03:57:50 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:50 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570" returned: 0 in 0.365s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836343273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23c0069-ae25-40aa-bb8e-02d3770ce512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:45Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Creating volume f23c0069-ae25-40aa-bb8e-02d3770ce512 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:50 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c924ffe-8863-4ccc-9169-b7aa480cf3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e4518b-54b5-4701-ba09-8f872ce28570', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:50 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 1073741824 Sep 09 03:57:50 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15effee5-7344-4174-86c0-ee6c98b030c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:50 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume volume-90e4518b-54b5-4701-ba09-8f872ce28570 (90e4518b-54b5-4701-ba09-8f872ce28570): created successfully Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15effee5-7344-4174-86c0-ee6c98b030c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (89bbb161-2fbe-4f1f-b85e-92015d4eba52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:50 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-caf38469-3194-4a5c-9a60-cc4584340662 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created volume successfully. Sep 09 03:57:50 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.374s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:50 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Deleted volume successfully. Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1aace793-72e2-478c-a1b0-34460e907509 tempest-VolumeAndVolumeTypeFromImageTest-1761799872 None] Lock "cinder-dc6a5c8a-4a85-454d-a837-71f2a712e2c0-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:50 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a2507fc6-f2c1-4daf-ad29-94fb56d7b246" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-a2507fc6-f2c1-4daf-ad29-94fb56d7b246" released by "delete_volume" :: held 0.868s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created reservations ['19ac8815-14e5-4a4e-ae0e-6f18682ae541', '81809b23-cf0a-4f56-b614-1a8ded63e43c', '942f051d-c1ae-40e4-b0b9-5dfffe888779', '2c53cfd2-e2be-44bb-902e-02b65b07f2fd'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:50 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:50 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:50 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 1073741824" returned: 0 in 0.558s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:51 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 Sep 09 03:57:51 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:51 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.283s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Deleted volume successfully. Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-40295ed0-2e8a-4cfa-a040-12b3471d9003 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-a2507fc6-f2c1-4daf-ad29-94fb56d7b246-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:51 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512" returned: 0 in 0.302s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.741s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357205510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33c3aa4-ea0f-46aa-a0e3-ed359021fc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5365926bcf9b42728455470beb77aab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:45Z,use_quota=True,user_id='2b6a983081bd42ba9662b70db057be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Creating volume c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:51 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8285346b-38b4-4414-9fa1-1169d0d4a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23c0069-ae25-40aa-bb8e-02d3770ce512', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:51 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 1073741824 Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addfa992-6b06-4418-8215-3d425cdb8c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:51 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:51 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 (f23c0069-ae25-40aa-bb8e-02d3770ce512): created successfully Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addfa992-6b06-4418-8215-3d425cdb8c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (caae48ec-c96f-4dd4-9795-d71b9a8c6eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:51 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-eee92e1d-56b2-4071-9703-fc8c6f7e9048 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created volume successfully. Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:51 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 1073741824" returned: 0 in 0.624s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-quobyte-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:51 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[da709fd9-c3fa-4082-942a-c20e6e2a8fe5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:52 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 Sep 09 03:57:52 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:52 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f Sep 09 03:57:52 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:52 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82" returned: 0 in 0.275s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452cce25-f8b2-4c00-a5d3-1387af529b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5908ad-e1c3-4e1d-b5f6-6f421813b5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:52 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Volume volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 (c33c3aa4-ea0f-46aa-a0e3-ed359021fc82): created successfully Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5908ad-e1c3-4e1d-b5f6-6f421813b5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Flow 'volume_create_manager' (9f48040a-f975-4fa9-9e01-8beb424660b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-bcc7bf58-e817-4363-ba25-550bf161df50 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created volume successfully. Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Flow 'volume_create_manager' (43720070-6cd7-4da8-9ca8-dcc62dbd5a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b7032b-a621-475c-ac2e-b1669881af51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b7032b-a621-475c-ac2e-b1669881af51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1032140247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e360b8-39de-4add-a3a7-1bb1a8bfb0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227f84a067c745308cf27323f3050f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:52Z,use_quota=True,user_id='c858fe1fc44d4c369942a9dd67e33789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1648bab2-2f91-47aa-bdad-42d7bc911250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1648bab2-2f91-47aa-bdad-42d7bc911250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938e0698-e2e9-4e23-b5d1-5eeaefc88d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938e0698-e2e9-4e23-b5d1-5eeaefc88d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e360b8-39de-4add-a3a7-1bb1a8bfb0d6', 'volume_name': 'volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f27cdd-093a-4fa2-a20d-68d2b82ba201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f27cdd-093a-4fa2-a20d-68d2b82ba201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54709836-7392-4a90-ab19-2197684a429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:52 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Volume 88e360b8-39de-4add-a3a7-1bb1a8bfb0d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6', 'volume_size': 1} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:52 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1032140247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e360b8-39de-4add-a3a7-1bb1a8bfb0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227f84a067c745308cf27323f3050f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:52Z,use_quota=True,user_id='c858fe1fc44d4c369942a9dd67e33789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Creating volume 88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:52 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f" returned: 0 in 0.555s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:52 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 1073741824 Sep 09 03:57:52 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:52 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f Sep 09 03:57:52 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:52 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f" returned: 0 in 0.292s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f" released by "delete_volume" :: held 0.918s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:52 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created reservations ['16211a57-4795-444f-a275-4974237b87b6', 'e6208ec4-57bb-44fa-9715-74be4e5671d5', 'f8089a2e-4d53-4839-8310-417f7c77ca8e', '2008e411-23e0-4661-9030-01d3e653d795'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:53 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:53 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:53 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 1073741824" returned: 0 in 0.540s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:53 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 Sep 09 03:57:53 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:53 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.299s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:53 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Deleted volume successfully. Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d3882036-4a04-41ae-8add-0c9664e72a1b tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-9bc7a25d-5dd4-4e11-b8c3-71b965ab592f-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-quobyte-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:53 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" returned: 0 in 0.380s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddbe89d-75e3-436a-bfcc-4175f9a150a4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54709836-7392-4a90-ab19-2197684a429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1102442e-6e3c-4785-8345-2248ba8c0254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:53 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Volume volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 (88e360b8-39de-4add-a3a7-1bb1a8bfb0d6): created successfully Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1102442e-6e3c-4785-8345-2248ba8c0254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Flow 'volume_create_manager' (43720070-6cd7-4da8-9ca8-dcc62dbd5a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:53 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-89405346-88ec-431e-a0b0-152ab157ba3d tempest-VolumeDependencyTests-1623882446 None] Created volume successfully. Sep 09 03:57:53 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 Sep 09 03:57:53 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:53 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82" returned: 0 in 0.384s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:53 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82 Sep 09 03:57:53 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-789a6573-c0cd-41f0-aca4-68d86f70d376-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-789a6573-c0cd-41f0-aca4-68d86f70d376-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-quobyte-789a6573-c0cd-41f0-aca4-68d86f70d376" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:54 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82" returned: 0 in 0.304s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-789a6573-c0cd-41f0-aca4-68d86f70d376" acquired by "delete_volume" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82" released by "delete_volume" :: held 0.758s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b4973b-5f0c-46bb-a4f9-b1f099e17a07]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created reservations ['aba09af8-61ac-49e4-9a86-f450d5f07f53', '93b1ae4b-55cf-4763-a288-fe86056c4b68', '09a3cfe0-8d66-445a-8968-0db5257e1022', '20c36370-b80b-4977-ade2-94c8d1b16339'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:54 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 Sep 09 03:57:54 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:54 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:54 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-f23c0069-ae25-40aa-bb8e-02d3770ce512-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-f23c0069-ae25-40aa-bb8e-02d3770ce512-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-quobyte-f23c0069-ae25-40aa-bb8e-02d3770ce512" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-f23c0069-ae25-40aa-bb8e-02d3770ce512" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7455a00b-9dfc-4447-8b29-37e79a5249ec]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:54 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376" returned: 0 in 0.561s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:54 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376 Sep 09 03:57:54 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:54 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.511s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:54 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Deleted volume successfully. Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2ecd9f05-8105-4531-9baf-f49ef6c16bc0 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-c33c3aa4-ea0f-46aa-a0e3-ed359021fc82-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:55 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 Sep 09 03:57:55 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Creating offline snapshot 96e08dc6-bc7b-4811-be22-aa83fb17af14 of volume 88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb2e021-7f99-409b-8fd8-0f5111542a02]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:55 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 Sep 09 03:57:55 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:55 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-789a6573-c0cd-41f0-aca4-68d86f70d376" returned: 0 in 0.405s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-789a6573-c0cd-41f0-aca4-68d86f70d376" released by "delete_volume" :: held 1.035s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:55 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created reservations ['c4518b5c-5af9-493d-9262-ade0631791c5', 'c99bd5f1-9738-4d5b-a3a5-bee4aac215cc', 'c78aab19-db2a-49d9-942d-2d60705c0f16', 'b2f30149-965e-4744-92f4-f293bfa320bd'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512" returned: 0 in 0.559s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:55 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512 Sep 09 03:57:55 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:55 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:55 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:55 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" returned: 0 in 0.505s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:55 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 1G Sep 09 03:57:55 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:55 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f23c0069-ae25-40aa-bb8e-02d3770ce512" returned: 0 in 0.317s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-f23c0069-ae25-40aa-bb8e-02d3770ce512" released by "delete_volume" :: held 0.958s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created reservations ['0e001827-94a2-448d-bf5a-99a46c6c122d', '61cd2000-e253-4b5c-af67-1dade565d823', 'c673e771-8676-40d1-8da7-b5127d48b80e', '80e91a69-7d0e-4100-84b5-2e6a8d9c214a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:55 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.331s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:55 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Deleted volume successfully. Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b1265c0c-572d-4332-a7ed-1d6ce22b7738 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-789a6573-c0cd-41f0-aca4-68d86f70d376-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:55 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:55 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-90e4518b-54b5-4701-ba09-8f872ce28570-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-90e4518b-54b5-4701-ba09-8f872ce28570-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-quobyte-90e4518b-54b5-4701-ba09-8f872ce28570" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-90e4518b-54b5-4701-ba09-8f872ce28570" acquired by "delete_volume" :: waited 0.042s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4039938-9a66-4c7f-907d-40e12425338f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:56 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 1G" returned: 0 in 0.557s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:56 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 Sep 09 03:57:56 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:56 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:56 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 Sep 09 03:57:56 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Deleted volume successfully. Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-2c6ecf8c-de33-4bb0-b917-9955057b2dd4 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-f23c0069-ae25-40aa-bb8e-02d3770ce512-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-57854e19-3d7c-4c7b-89c8-346e5e262b02-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-57854e19-3d7c-4c7b-89c8-346e5e262b02-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-quobyte-57854e19-3d7c-4c7b-89c8-346e5e262b02" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-57854e19-3d7c-4c7b-89c8-346e5e262b02" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:56 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570" returned: 0 in 0.466s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a0a3c1-2ba6-476a-b2e1-730bf885c832]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:56 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14" returned: 0 in 0.424s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:56 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 is being set with open permissions: ugo+rw Sep 09 03:57:56 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570 Sep 09 03:57:56 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:56 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 Sep 09 03:57:56 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:56 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 Sep 09 03:57:56 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:56 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-90e4518b-54b5-4701-ba09-8f872ce28570" returned: 0 in 0.281s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-90e4518b-54b5-4701-ba09-8f872ce28570" released by "delete_volume" :: held 0.794s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:56 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14" returned: 0 in 0.274s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:56 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created reservations ['fa79ff25-385f-448b-8a7d-659c40091ca9', '12eb07f4-1bf3-41df-8e45-3e10e3af1a03', '661436d2-7584-4f4f-bb7f-fe5e9a6d86b0', '391f76ee-15a7-4485-99cb-2bacf4d0417e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:56 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.info Sep 09 03:57:56 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:57 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02" returned: 0 in 0.481s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:57 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:57 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:57 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02 Sep 09 03:57:57 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-1631b617-591b-4071-8868-cda3240f4689-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-1631b617-591b-4071-8868-cda3240f4689-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:57 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.info" returned: 0 in 0.383s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:57 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.info is being set with open permissions: ugo+rw Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-quobyte-1631b617-591b-4071-8868-cda3240f4689" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-1631b617-591b-4071-8868-cda3240f4689" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:57 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.info Sep 09 03:57:57 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:57 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a7b569-e3c3-4e16-95f2-271d997a458b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-57854e19-3d7c-4c7b-89c8-346e5e262b02" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-57854e19-3d7c-4c7b-89c8-346e5e262b02" released by "delete_volume" :: held 0.870s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:57 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.418s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Deleted volume successfully. Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created reservations ['c5757453-707c-459f-ab0c-808dfc0d7e65', 'c4cdea43-5ea3-4e6a-a3e2-eca0b4e0fd15', '1381c009-67ac-4068-8204-31fc10dd2586', '1151c4a0-dd26-46e8-95a5-079f75cf55f6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-59bf158e-0cc0-4c95-9b46-4b98133cf0ed tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-90e4518b-54b5-4701-ba09-8f872ce28570-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:57 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 Sep 09 03:57:57 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:57 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:57 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:57 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.info" returned: 0 in 0.387s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fbe755f5-8f76-4b56-865d-d1e4bf3fc85a tempest-VolumeDependencyTests-1623882446 None] Create snapshot completed successfully Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "cinder-quobyte-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9794a0fc-9bb0-4244-887b-36b4c8439a39]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:57 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689" returned: 0 in 0.575s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:57 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689 Sep 09 03:57:57 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:58 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:58 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 Sep 09 03:57:58 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.387s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:58 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Deleted volume successfully. Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-bb36bcaf-078c-4191-9f0b-e557e01b3c7c tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-57854e19-3d7c-4c7b-89c8-346e5e262b02-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:58 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1631b617-591b-4071-8868-cda3240f4689" returned: 0 in 0.317s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-1631b617-591b-4071-8868-cda3240f4689" released by "delete_volume" :: held 0.942s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:58 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3" returned: 0 in 0.426s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:58 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3 Sep 09 03:57:58 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created reservations ['f28d4166-435f-4c6f-9f4f-2640c6a075fe', 'fa50b6c8-dab1-41a3-90b9-215b24b6b704', '2c61fa94-7f32-42d0-9c2f-67bd5952ff56', '68017a1d-26db-452b-b94c-3bc418012c2e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:58 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:58 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:58 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3" returned: 0 in 0.396s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-quobyte-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3" released by "delete_volume" :: held 0.886s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:58 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Created reservations ['32f5be4e-9623-455d-9730-abb780635324', '1125c803-dba4-46be-b324-536a20308241', 'd9c983e9-09dd-4a7f-911e-5f5e9d96d361', 'aaddd7c0-eb9c-4133-9566-db410ec52c0a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:59 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:57:59 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:57:59 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.471s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Deleted volume successfully. Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Flow 'volume_create_manager' (e8e67840-f22d-4eda-ad11-52ef9bd5dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f08a95-0487-4d3f-9e07-d295d14eac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f08a95-0487-4d3f-9e07-d295d14eac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2003196739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79afe290-1a03-4bf3-8e73-5b95682cea9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227f84a067c745308cf27323f3050f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=96e08dc6-bc7b-4811-be22-aa83fb17af14,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:57:59Z,use_quota=True,user_id='c858fe1fc44d4c369942a9dd67e33789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e25345-fb5e-41d1-b77e-dedec4e34e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e25345-fb5e-41d1-b77e-dedec4e34e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98d2a3d-8068-45cd-8d9c-b36c154cc644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98d2a3d-8068-45cd-8d9c-b36c154cc644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79afe290-1a03-4bf3-8e73-5b95682cea9d', 'volume_name': 'volume-79afe290-1a03-4bf3-8e73-5b95682cea9d', 'volume_size': 1, 'snapshot_id': '96e08dc6-bc7b-4811-be22-aa83fb17af14'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68666aa-f0a6-46d2-b56f-dc6136a8adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68666aa-f0a6-46d2-b56f-dc6136a8adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704903f5-844d-49ad-9bc6-204e708316f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:57:59 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Volume 79afe290-1a03-4bf3-8e73-5b95682cea9d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79afe290-1a03-4bf3-8e73-5b95682cea9d', 'volume_size': 1, 'snapshot_id': '96e08dc6-bc7b-4811-be22-aa83fb17af14'} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-58886dd6-a54d-4f07-8420-a91f0e8f1e29 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-1631b617-591b-4071-8868-cda3240f4689-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-quobyte-96e08dc6-bc7b-4811-be22-aa83fb17af14-79afe290-1a03-4bf3-8e73-5b95682cea9d" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-96e08dc6-bc7b-4811-be22-aa83fb17af14-79afe290-1a03-4bf3-8e73-5b95682cea9d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Creating volume 79afe290-1a03-4bf3-8e73-5b95682cea9d from snapshot 96e08dc6-bc7b-4811-be22-aa83fb17af14 {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-quobyte-79afe290-1a03-4bf3-8e73-5b95682cea9d" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-79afe290-1a03-4bf3-8e73-5b95682cea9d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] snapshot: 96e08dc6-bc7b-4811-be22-aa83fb17af14, volume: 79afe290-1a03-4bf3-8e73-5b95682cea9d, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[67383d5b-971c-44c3-bc4f-4a4815faaf25]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:59 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.303s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:57:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Deleted volume successfully. Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-47687d7d-b6a4-4ba5-8836-571db4535928 tempest-CreateVolumesFromSourceVolumeTest-1963847522 None] Lock "cinder-5ca6dc08-bc35-45d7-a227-ca0c3eedbad3-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:57:59 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 Sep 09 03:57:59 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-a41dd1c4-f909-4e58-93b7-92f8b1904dd4-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-a41dd1c4-f909-4e58-93b7-92f8b1904dd4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-quobyte-a41dd1c4-f909-4e58-93b7-92f8b1904dd4" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-a41dd1c4-f909-4e58-93b7-92f8b1904dd4" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[54743061-f6da-42e9-9cce-aff2e82040f6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:59 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14" returned: 0 in 0.431s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8961b-ebed-45ec-b9f5-2c305da99b21]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:57:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:57:59 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 Sep 09 03:57:59 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:57:59 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 Sep 09 03:57:59 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:00 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4" returned: 0 in 0.444s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:00 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4 Sep 09 03:58:00 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:00 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" returned: 0 in 0.516s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:00 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d Sep 09 03:58:00 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:00 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a41dd1c4-f909-4e58-93b7-92f8b1904dd4" returned: 0 in 0.328s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-a41dd1c4-f909-4e58-93b7-92f8b1904dd4" released by "delete_volume" :: held 0.835s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created reservations ['91e05151-7a8e-41e3-ba72-942747ff5126', 'e8145373-ed1c-4067-bb70-ea946610673a', 'c771b8f2-5b89-47d1-947e-623b9e66608c', '2918dd7c-3f04-42df-a77a-6765b4fa6114'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:00 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:00 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-0e510131-b38c-4012-bc02-39bb8d41149a-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-0e510131-b38c-4012-bc02-39bb8d41149a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-quobyte-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-quobyte-0e510131-b38c-4012-bc02-39bb8d41149a" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-0e510131-b38c-4012-bc02-39bb8d41149a" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Deleting offline snapshot 0e510131-b38c-4012-bc02-39bb8d41149a of volume fb03ad46-4bc3-456f-a39d-0d87a0dff63a {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] snapshot_file for this snap is: volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e7ab80-f127-4b34-94c1-5361cb4aa00d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:01 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a Sep 09 03:58:01 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:01 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.777s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:01 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Deleted volume successfully. Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-f6bd8b61-b6db-40e8-8bab-cceab2289498 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-a41dd1c4-f909-4e58-93b7-92f8b1904dd4-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:01 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a" returned: 0 in 0.780s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[788b736f-7d4e-4190-9674-75fb91648f49]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:02 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a Sep 09 03:58:02 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:02 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" returned: 0 in 0.893s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:02 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a Sep 09 03:58:02 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:03 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a" returned: 0 in 0.897s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:03 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a Sep 09 03:58:03 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:04 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a.0e510131-b38c-4012-bc02-39bb8d41149a" returned: 0 in 0.697s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-0e510131-b38c-4012-bc02-39bb8d41149a" released by "_delete_snapshot" :: held 3.633s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" released by "delete_snapshot" :: held 3.710s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:04 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created reservations ['8ea871b0-97b4-41fe-8e1f-e6aeb3afe44e', 'bdebcfa4-82dc-4a4f-903f-8d333c3786c1', '6a861342-da4f-4963-ba4a-635c72f30b2a', '6b079c96-151d-41ba-ac31-3a04bb952f8c'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:05 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Delete snapshot completed successfully. Sep 09 03:58:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-801fc477-3dfd-4b9e-a411-4d8ecb0d10e8 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-0e510131-b38c-4012-bc02-39bb8d41149a-delete_snapshot" released by "delete_snapshot" :: held 4.183s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-fb03ad46-4bc3-456f-a39d-0d87a0dff63a-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-fb03ad46-4bc3-456f-a39d-0d87a0dff63a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "cinder-quobyte-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" acquired by "delete_volume" :: waited 0.038s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[460062fa-dd8e-4e49-82be-e7051ddfe6ba]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:06 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a Sep 09 03:58:06 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:06 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d" returned: 0 in 6.242s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:58:06 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Converted 1024.00 MB image at 163.94 MB/s Sep 09 03:58:06 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d is being set with open permissions: ugo+rw Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:06 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d Sep 09 03:58:06 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:06 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" returned: 0 in 0.863s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:06 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a Sep 09 03:58:06 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:06 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d" returned: 0 in 0.374s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-79afe290-1a03-4bf3-8e73-5b95682cea9d" released by "_copy_volume_from_snapshot" :: held 7.664s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-96e08dc6-bc7b-4811-be22-aa83fb17af14-79afe290-1a03-4bf3-8e73-5b95682cea9d" released by "_create_volume_from_snapshot" :: held 7.732s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.753s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704903f5-844d-49ad-9bc6-204e708316f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79afe290-1a03-4bf3-8e73-5b95682cea9d', 'volume_size': 1, 'snapshot_id': '96e08dc6-bc7b-4811-be22-aa83fb17af14'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2e22fd-b66a-4b4b-aa5a-33fc2366ea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Volume volume-79afe290-1a03-4bf3-8e73-5b95682cea9d (79afe290-1a03-4bf3-8e73-5b95682cea9d): created successfully Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2e22fd-b66a-4b4b-aa5a-33fc2366ea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Flow 'volume_create_manager' (e8e67840-f22d-4eda-ad11-52ef9bd5dd19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a00a3313-a411-4f44-8e49-202c79fb30b8 tempest-VolumeDependencyTests-1623882446 None] Created volume successfully. Sep 09 03:58:07 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" returned: 0 in 0.382s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-quobyte-fb03ad46-4bc3-456f-a39d-0d87a0dff63a" released by "delete_volume" :: held 1.450s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Created reservations ['565c24bf-6201-4378-a2ee-ceda7035041e', '2201c2ef-f15b-4b65-88a6-0e5b3a540d2d', '5033af32-07f9-491e-ab4e-c515fe13f627', '379f8a8e-e035-4c8e-ad94-20d1168548b7'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:07 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:07 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Flow 'volume_create_manager' (4b24a9a5-872c-48ae-8b4d-9aa318f3d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc2b521-819f-464d-93dd-25850503aa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc2b521-819f-464d-93dd-25850503aa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407e013d-1534-4f5f-ab9f-71b0fb2eeb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a2051a7bded447db00dcdd00ec3f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:07Z,use_quota=True,user_id='fc536faa3c5349cb89f70e8c419d13bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f33292-723a-4f36-923f-98af9264c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f33292-723a-4f36-923f-98af9264c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f70501-2da8-4376-8ae2-7b8661a2037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f70501-2da8-4376-8ae2-7b8661a2037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407e013d-1534-4f5f-ab9f-71b0fb2eeb70', 'volume_name': 'volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a0c7df-97bf-424e-b597-3220fe46dd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a0c7df-97bf-424e-b597-3220fe46dd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e0fefa-eb38-42c5-a182-dbfb1ccff134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Volume 407e013d-1534-4f5f-ab9f-71b0fb2eeb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70', 'volume_size': 1} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407e013d-1534-4f5f-ab9f-71b0fb2eeb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a2051a7bded447db00dcdd00ec3f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:07Z,use_quota=True,user_id='fc536faa3c5349cb89f70e8c419d13bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Creating volume 407e013d-1534-4f5f-ab9f-71b0fb2eeb70 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:07 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:07 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 1073741824 Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:07 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (ac217e6c-1c6a-45b2-bdfb-de1130a984a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d51d088-8b27-408c-8ba1-637099350be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d51d088-8b27-408c-8ba1-637099350be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478083514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:07Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adedadef-f3f8-41be-bfb9-0f741db65d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adedadef-f3f8-41be-bfb9-0f741db65d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2193f8d7-7200-43cd-adbd-e613f2b370b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2193f8d7-7200-43cd-adbd-e613f2b370b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05', 'volume_name': 'volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253e8b62-e9fc-44b1-b056-d28d28e18f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253e8b62-e9fc-44b1-b056-d28d28e18f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26ec288-eed6-4be9-b39c-dd8f5a53f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:07 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Volume e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05', 'volume_size': 1} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:07 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.252s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Deleted volume successfully. Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-49d08a21-778f-42d0-8073-a6da11491864 tempest-CreateVolumesFromSnapshotTest-1904111848 None] Lock "cinder-fb03ad46-4bc3-456f-a39d-0d87a0dff63a-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:07 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 1073741824" returned: 0 in 0.424s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:07 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 Sep 09 03:58:07 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:08 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70" returned: 0 in 0.243s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478083514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:07Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Creating volume e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:08 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-96e08dc6-bc7b-4811-be22-aa83fb17af14-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e0fefa-eb38-42c5-a182-dbfb1ccff134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134fb231-c8ee-4c49-926e-f092e532a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:08 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 1073741824 Sep 09 03:58:08 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-96e08dc6-bc7b-4811-be22-aa83fb17af14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-quobyte-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:08 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Volume volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 (407e013d-1534-4f5f-ab9f-71b0fb2eeb70): created successfully Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134fb231-c8ee-4c49-926e-f092e532a13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Flow 'volume_create_manager' (4b24a9a5-872c-48ae-8b4d-9aa318f3d07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-quobyte-96e08dc6-bc7b-4811-be22-aa83fb17af14" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fcd74b0f-1056-4ded-9107-39c463abc8f7 tempest-CinderUnicodeTest-544658580 None] Created volume successfully. Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-96e08dc6-bc7b-4811-be22-aa83fb17af14" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Deleting offline snapshot 96e08dc6-bc7b-4811-be22-aa83fb17af14 of volume 88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] snapshot_file for this snap is: volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d4810b-a14f-4f5c-bc91-02129f6c94a4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:08 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 Sep 09 03:58:08 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:08 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 1073741824" returned: 0 in 0.521s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:08 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14" returned: 0 in 0.396s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:08 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 Sep 09 03:58:08 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0d0e43-9d6a-423e-89c7-b8e1d1cd3406]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:08 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 Sep 09 03:58:08 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:08 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" returned: 0 in 0.288s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26ec288-eed6-4be9-b39c-dd8f5a53f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b524e9-7712-49fc-810a-cb43ff6dfecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:08 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Volume volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 (e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05): created successfully Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b524e9-7712-49fc-810a-cb43ff6dfecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (ac217e6c-1c6a-45b2-bdfb-de1130a984a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-7fccc8c3-a786-4040-a32c-abba2cb4bd47 tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:58:09 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" returned: 0 in 0.628s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:09 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 Sep 09 03:58:09 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:09 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14" returned: 0 in 0.567s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:09 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14 Sep 09 03:58:09 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:09 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Flow 'volume_create_manager' (17b80df5-c4ce-4ebd-a738-f935cce955f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb458fc7-c199-4cae-838f-ca89be453a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb458fc7-c199-4cae-838f-ca89be453a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1072536156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f56177-6e8e-4f59-92e4-102ddb794933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a2051a7bded447db00dcdd00ec3f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:10Z,use_quota=True,user_id='fc536faa3c5349cb89f70e8c419d13bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15668dcf-0791-4c74-874b-7c2bda03e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15668dcf-0791-4c74-874b-7c2bda03e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636a0018-8fe3-4b13-824a-4d8bff76ad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636a0018-8fe3-4b13-824a-4d8bff76ad1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f56177-6e8e-4f59-92e4-102ddb794933', 'volume_name': 'volume-88f56177-6e8e-4f59-92e4-102ddb794933', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26da35da-1eb8-4cc1-b579-6e8202568bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26da35da-1eb8-4cc1-b579-6e8202568bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad2c49a-aed4-4f69-915c-310e02c1ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Volume 88f56177-6e8e-4f59-92e4-102ddb794933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f56177-6e8e-4f59-92e4-102ddb794933', 'volume_size': 1} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot 45ef5d2d-788a-46f3-9195-dcdf37e1a118 of volume e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b52538f-0465-46ec-8ebc-8c58cfb3b1d5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:10 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6.96e08dc6-bc7b-4811-be22-aa83fb17af14" returned: 0 in 0.293s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-96e08dc6-bc7b-4811-be22-aa83fb17af14" released by "_delete_snapshot" :: held 2.024s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" released by "delete_snapshot" :: held 2.059s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:10 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 Sep 09 03:58:10 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Created reservations ['16733956-3550-4cf9-9767-7decfa1bfec2', 'f6231eea-0521-42fb-b076-a497c1bc4484', '97bdce3e-302d-444d-8172-5798684134bf', 'd1e0811d-8ae9-4076-8180-7495c93defad'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Delete snapshot completed successfully. Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-e400589f-94d8-48ed-896e-12663a550548 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-96e08dc6-bc7b-4811-be22-aa83fb17af14-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:10 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" returned: 0 in 0.436s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:10 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 1G Sep 09 03:58:10 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:11 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 1G" returned: 0 in 0.443s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:11 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 Sep 09 03:58:11 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:11 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118" returned: 0 in 0.302s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:11 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 is being set with open permissions: ugo+rw Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:11 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 Sep 09 03:58:11 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-quobyte-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c847e1c6-dda2-4164-93fc-ae42c0f780e4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:11 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 Sep 09 03:58:11 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:11 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118" returned: 0 in 0.305s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:11 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.info Sep 09 03:58:11 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:11 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" returned: 0 in 0.418s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:11 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6 Sep 09 03:58:11 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:11 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.info" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:11 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.info is being set with open permissions: ugo+rw Sep 09 03:58:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:11 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.info Sep 09 03:58:11 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:12 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" returned: 0 in 0.265s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6" released by "delete_volume" :: held 0.749s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:12 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.info" returned: 0 in 0.280s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.162s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1072536156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f56177-6e8e-4f59-92e4-102ddb794933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a2051a7bded447db00dcdd00ec3f66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:10Z,use_quota=True,user_id='fc536faa3c5349cb89f70e8c419d13bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Creating volume 88f56177-6e8e-4f59-92e4-102ddb794933 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:12 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Created reservations ['b599e89b-523d-4a05-89c7-dc57f9908194', 'd387f1c1-228b-4ce3-9231-813ee94003f5', 'f03a5595-0649-4065-8baa-76af40511327', 'd17b7ab8-0c57-42f2-8153-083174ca443a'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:12 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 1073741824 Sep 09 03:58:12 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-949b2fca-1c03-4224-ae8c-df52afdb5ada tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:12 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:12 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-79afe290-1a03-4bf3-8e73-5b95682cea9d-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-79afe290-1a03-4bf3-8e73-5b95682cea9d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "cinder-quobyte-79afe290-1a03-4bf3-8e73-5b95682cea9d" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-79afe290-1a03-4bf3-8e73-5b95682cea9d" acquired by "delete_volume" :: waited 0.038s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[03044013-c5d8-4de7-91fa-999a4ba4ee9c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:12 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.412s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Deleted volume successfully. Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-550a7e6f-fc92-4878-a43c-14b22da393fe tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-88e360b8-39de-4add-a3a7-1bb1a8bfb0d6-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:12 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d Sep 09 03:58:12 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:12 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 1073741824" returned: 0 in 0.588s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:12 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 Sep 09 03:58:12 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-45ef5d2d-788a-46f3-9195-dcdf37e1a118-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-45ef5d2d-788a-46f3-9195-dcdf37e1a118-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-45ef5d2d-788a-46f3-9195-dcdf37e1a118" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-45ef5d2d-788a-46f3-9195-dcdf37e1a118" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot 45ef5d2d-788a-46f3-9195-dcdf37e1a118 of volume e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dab034-8dec-4db4-96a6-208ede6d5374]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:13 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d" returned: 0 in 0.497s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:13 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:13 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d Sep 09 03:58:13 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad2c49a-aed4-4f69-915c-310e02c1ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f56177-6e8e-4f59-92e4-102ddb794933', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed612dd9-d656-4cad-977a-3c7b30260afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:13 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Volume volume-88f56177-6e8e-4f59-92e4-102ddb794933 (88f56177-6e8e-4f59-92e4-102ddb794933): created successfully Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed612dd9-d656-4cad-977a-3c7b30260afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Flow 'volume_create_manager' (17b80df5-c4ce-4ebd-a738-f935cce955f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5636118d-f479-40cd-ad0f-d0a50c17dcc2 tempest-CinderUnicodeTest-544658580 None] Created volume successfully. Sep 09 03:58:13 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 Sep 09 03:58:13 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:13 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-79afe290-1a03-4bf3-8e73-5b95682cea9d" returned: 0 in 0.259s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-quobyte-79afe290-1a03-4bf3-8e73-5b95682cea9d" released by "delete_volume" :: held 0.808s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Created reservations ['36502eb3-3544-4e16-9f2a-441c123ab6b0', 'c3362d50-8260-4605-adc0-46626f578898', 'fa211dc9-fb3d-41c9-8d05-00c202c7bf0d', '15c0a29b-126e-4c6a-b962-8642406fe155'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:13 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118" returned: 0 in 0.435s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:13 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:13 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d487493c-f9d5-429a-b22c-12ec7aee39bc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:13 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 Sep 09 03:58:13 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:13 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.355s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:13 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Deleted volume successfully. Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7c4ada0-94e1-4b6c-9e79-ce6485285233 tempest-VolumeDependencyTests-1623882446 None] Lock "cinder-79afe290-1a03-4bf3-8e73-5b95682cea9d-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:14 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" returned: 0 in 0.460s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:14 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 Sep 09 03:58:14 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Flow 'volume_create_manager' (0120c7fb-bab5-4db9-975a-b04905315c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69604f9-445c-4c50-b7d3-d05152ed50c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69604f9-445c-4c50-b7d3-d05152ed50c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780597f2-c3dd-4253-b02e-83d8186dc3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8caa34523ea4e229ba2fcdee9d7d22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:14Z,use_quota=True,user_id='7d41898743b14b5f8817e95b6cb3f6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20f1583-86e1-4df9-af0e-884c5ef60889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20f1583-86e1-4df9-af0e-884c5ef60889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8530431-2908-4b63-907a-f1180bb10624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.image.glance [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Creating Keystone auth plugin from conf {{(pid=87597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 03:58:14 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118" returned: 0 in 0.421s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:14 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118 Sep 09 03:58:14 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Creating offline snapshot 93f55aa6-e040-4435-9305-ef0827d21f59 of volume 88f56177-6e8e-4f59-92e4-102ddb794933 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[afce7220-4fb9-48ad-853a-94cc2d92083e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:14 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 Sep 09 03:58:14 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:14 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05.45ef5d2d-788a-46f3-9195-dcdf37e1a118" returned: 0 in 0.277s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-45ef5d2d-788a-46f3-9195-dcdf37e1a118" released by "_delete_snapshot" :: held 1.761s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" released by "delete_snapshot" :: held 1.802s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8530431-2908-4b63-907a-f1180bb10624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '780597f2-c3dd-4253-b02e-83d8186dc3fd', 'volume_name': 'volume-780597f2-c3dd-4253-b02e-83d8186dc3fd', 'volume_size': 1, 'image_id': '9dcce78b-ae53-46a2-a27c-541c9073876f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dcce78b-ae53-46a2-a27c-541c9073876f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f672aa5d652ff0d44ade3027cc17dc8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8caa34523ea4e229ba2fcdee9d7d22e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd2a191a59fc1f3ac55698ef9921c901dcbcde7901589b1e9ac307be7514e046424357550c1f7fbeefd17a566cd9734a5599b1b133f41c158482cfff5f3715e8', 'id': '9dcce78b-ae53-46a2-a27c-541c9073876f', 'created_at': datetime.datetime(2026, 9, 9, 1, 58, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 58, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dcce78b-ae53-46a2-a27c-541c9073876f/file', 'properties': {}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bf5a9f-dc7f-446f-99e3-618c8cd3eb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bf5a9f-dc7f-446f-99e3-618c8cd3eb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8ea75b-3850-4689-8efa-d274ea7c5616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:15 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Volume 780597f2-c3dd-4253-b02e-83d8186dc3fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-780597f2-c3dd-4253-b02e-83d8186dc3fd', 'volume_size': 1, 'image_id': '9dcce78b-ae53-46a2-a27c-541c9073876f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dcce78b-ae53-46a2-a27c-541c9073876f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f672aa5d652ff0d44ade3027cc17dc8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8caa34523ea4e229ba2fcdee9d7d22e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd2a191a59fc1f3ac55698ef9921c901dcbcde7901589b1e9ac307be7514e046424357550c1f7fbeefd17a566cd9734a5599b1b133f41c158482cfff5f3715e8', 'id': '9dcce78b-ae53-46a2-a27c-541c9073876f', 'created_at': datetime.datetime(2026, 9, 9, 1, 58, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 58, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dcce78b-ae53-46a2-a27c-541c9073876f/file', 'properties': {}}, 'image_service': } Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Trying to clone 780597f2-c3dd-4253-b02e-83d8186dc3fd from image 9dcce78b-ae53-46a2-a27c-541c9073876f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dcce78b-ae53-46a2-a27c-541c9073876f', 'metadata': {}}]). {{(pid=87597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Created reservations ['272d1da2-77ce-4617-bb0f-9841fedc0f1c', '3dd6754c-625c-44c2-92b2-71b735174c3c', '8299aaba-08da-45b8-8a08-6851fd28828a', '873cca14-e2cb-4b27-815d-723a28d99599'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:15 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933" returned: 0 in 0.445s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:15 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 1G Sep 09 03:58:15 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 03:58:15 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Image download 0.00 MB at 0.00 MB/s Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ec044d3c-1a71-47c5-a660-13b1f0174967 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-45ef5d2d-788a-46f3-9195-dcdf37e1a118-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dca9074-9829-4f33-a0c7-71ac9d491922]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:15 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD Sep 09 03:58:15 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87f9380-24b5-4129-9f95-bb0b3efb415c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:15 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 1G" returned: 0 in 0.556s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f56177-6e8e-4f59-92e4-102ddb794933 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:15 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 Sep 09 03:58:15 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:15 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f56177-6e8e-4f59-92e4-102ddb794933 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 Sep 09 03:58:15 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:15 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:15 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD Sep 09 03:58:15 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:16 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:16 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" returned: 0 in 0.474s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f56177-6e8e-4f59-92e4-102ddb794933 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59" returned: 0 in 0.356s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:16 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 is being set with open permissions: ugo+rw Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:16 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05 Sep 09 03:58:16 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:16 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 Sep 09 03:58:16 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:16 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Temporary image 9dcce78b-ae53-46a2-a27c-541c9073876f is fetched for user 7d41898743b14b5f8817e95b6cb3f6d6. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a83943-521e-4999-b70c-7855c651744d]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:16 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05" released by "delete_volume" :: held 0.849s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:16 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59" returned: 0 in 0.322s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:16 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD Sep 09 03:58:16 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:16 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.info Sep 09 03:58:16 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Created reservations ['9d9909aa-48e4-48b6-bf73-8c9e19b17af1', '8491c1c4-09ee-42a9-bb05-ff34779aee21', 'b0e2eff0-6063-4f30-b8a1-614b08638b24', '974481cb-00c4-479e-8931-304165b70dde'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:16 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:16 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:16 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:16 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.info" returned: 0 in 0.373s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:16 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.info is being set with open permissions: ugo+rw Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:16 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.info Sep 09 03:58:16 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:16 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD Sep 09 03:58:16 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:16 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.295s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:58:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-096873cb-176a-4a9d-897f-02954fd2967c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-e1d2a1fa-bc4d-473a-a2ef-643dd9a3ae05-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:17 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.info" returned: 0 in 0.275s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a114aec9-c834-4bde-a073-ec8bc5d15061 tempest-CinderUnicodeTest-544658580 None] Create snapshot completed successfully Sep 09 03:58:17 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780597f2-c3dd-4253-b02e-83d8186dc3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8caa34523ea4e229ba2fcdee9d7d22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:14Z,use_quota=True,user_id='7d41898743b14b5f8817e95b6cb3f6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Creating volume 780597f2-c3dd-4253-b02e-83d8186dc3fd {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:17 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:17 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd 1073741824 Sep 09 03:58:17 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:17 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd 1073741824" returned: 0 in 0.491s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:17 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd Sep 09 03:58:17 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:17 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd" returned: 0 in 0.256s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:17 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Attempting download of 9dcce78b-ae53-46a2-a27c-541c9073876f ((None, [{'url': 'file:///opt/stack/data/glance/images/9dcce78b-ae53-46a2-a27c-541c9073876f', 'metadata': {}}])) to volume 780597f2-c3dd-4253-b02e-83d8186dc3fd. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b0d286-94cf-4aeb-8b3d-0256f41a7454]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dcce78b-ae53-46a2-a27c-541c9073876f_rwpgcd1d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Acquiring lock "cinder-93f55aa6-e040-4435-9305-ef0827d21f59-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-93f55aa6-e040-4435-9305-ef0827d21f59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Acquiring lock "cinder-quobyte-88f56177-6e8e-4f59-92e4-102ddb794933" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-quobyte-88f56177-6e8e-4f59-92e4-102ddb794933" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Acquiring lock "cinder-quobyte-93f55aa6-e040-4435-9305-ef0827d21f59" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-quobyte-93f55aa6-e040-4435-9305-ef0827d21f59" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Deleting offline snapshot 93f55aa6-e040-4435-9305-ef0827d21f59 of volume 88f56177-6e8e-4f59-92e4-102ddb794933 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] snapshot_file for this snap is: volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[53016a3f-cdd4-499f-b933-f733abeda847]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:18 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dcce78b-ae53-46a2-a27c-541c9073876f_rwpgcd1d Sep 09 03:58:18 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (3fee61f7-9067-47ac-a622-ef50ce29cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b39c6a5-9207-403b-8195-b9b1a0626ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b39c6a5-9207-403b-8195-b9b1a0626ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513555462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360bbb68-60d4-40e6-8cc8-ab127021f300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:18Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77632e4-6bc6-4f98-bd1a-ef6c93e590e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77632e4-6bc6-4f98-bd1a-ef6c93e590e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:18 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 Sep 09 03:58:18 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e51ef55-573b-4750-8288-6345fd7fd9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e51ef55-573b-4750-8288-6345fd7fd9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360bbb68-60d4-40e6-8cc8-ab127021f300', 'volume_name': 'volume-360bbb68-60d4-40e6-8cc8-ab127021f300', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f052d8e-cf44-4942-b21c-037c8e8723de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f052d8e-cf44-4942-b21c-037c8e8723de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df627fb-8ad0-4bea-ae1e-7bd9280d1d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:18 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Volume 360bbb68-60d4-40e6-8cc8-ab127021f300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360bbb68-60d4-40e6-8cc8-ab127021f300', 'volume_size': 1} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513555462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360bbb68-60d4-40e6-8cc8-ab127021f300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:18Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Creating volume 360bbb68-60d4-40e6-8cc8-ab127021f300 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:18 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:18 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 1073741824 Sep 09 03:58:18 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:18 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dcce78b-ae53-46a2-a27c-541c9073876f_rwpgcd1d" returned: 0 in 0.416s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dcce78b-ae53-46a2-a27c-541c9073876f_rwpgcd1d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:18 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dcce78b-ae53-46a2-a27c-541c9073876f_rwpgcd1d Sep 09 03:58:18 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:18 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59" returned: 0 in 0.500s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f56177-6e8e-4f59-92e4-102ddb794933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca654c5-9742-4166-ad44-34fae727458d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:18 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 Sep 09 03:58:18 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:18 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dcce78b-ae53-46a2-a27c-541c9073876f_rwpgcd1d" returned: 1 in 0.476s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dcce78b-ae53-46a2-a27c-541c9073876f_rwpgcd1d' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b50498f-05b6-46e3-b105-856dd63c851b]: (4, 'raw') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:18 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 1073741824" returned: 0 in 0.611s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:19 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 Sep 09 03:58:19 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:19 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD Sep 09 03:58:19 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:19 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933" returned: 0 in 0.454s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:19 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 Sep 09 03:58:19 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:19 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300" returned: 0 in 0.307s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df627fb-8ad0-4bea-ae1e-7bd9280d1d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360bbb68-60d4-40e6-8cc8-ab127021f300', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56845fd7-d246-482b-a2a6-d5867c879c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:19 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Volume volume-360bbb68-60d4-40e6-8cc8-ab127021f300 (360bbb68-60d4-40e6-8cc8-ab127021f300): created successfully Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56845fd7-d246-482b-a2a6-d5867c879c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (3fee61f7-9067-47ac-a622-ef50ce29cfee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:19 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-84843b0e-5c0f-41e6-acf6-30121821dc16 tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:58:19 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD Sep 09 03:58:19 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:19 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59" returned: 0 in 0.464s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:19 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59 Sep 09 03:58:19 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:19 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] 9dcce78b-ae53-46a2-a27c-541c9073876f was raw, converting to qcow2 {{(pid=87597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:19 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd Sep 09 03:58:19 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:19 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933.93f55aa6-e040-4435-9305-ef0827d21f59" returned: 0 in 0.296s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-quobyte-93f55aa6-e040-4435-9305-ef0827d21f59" released by "_delete_snapshot" :: held 1.860s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-quobyte-88f56177-6e8e-4f59-92e4-102ddb794933" released by "delete_snapshot" :: held 1.892s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Created reservations ['6b461b77-51b6-4851-ab3f-f4777d4ef06f', '96488e18-22ed-4cc6-b5ea-6b7c2dba5a31', '81659cec-e626-4e15-8b4e-a3fdae40b3eb', '17b8900e-189b-4d55-b610-de11e8817293'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:20 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Delete snapshot completed successfully. Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-aeeda704-72af-4a40-97e8-610e97a4ba7d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-93f55aa6-e040-4435-9305-ef0827d21f59-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Acquiring lock "cinder-88f56177-6e8e-4f59-92e4-102ddb794933-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Lock "cinder-88f56177-6e8e-4f59-92e4-102ddb794933-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Acquiring lock "cinder-quobyte-88f56177-6e8e-4f59-92e4-102ddb794933" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Lock "cinder-quobyte-88f56177-6e8e-4f59-92e4-102ddb794933" acquired by "delete_volume" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:20 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd" returned: 0 in 0.624s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dcce78b-ae53-46a2-a27c-541c9073876f_14c_mm7adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 03:58:20 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a4a82a-c0cb-42a7-941f-f5c662f9ec2d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:20 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd 1G Sep 09 03:58:20 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot 5a06c5ae-3d08-4e6f-9901-fca003f0cfee of volume 360bbb68-60d4-40e6-8cc8-ab127021f300 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[086c1f96-bd74-45f7-a593-dd9e005ee820]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:20 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 Sep 09 03:58:20 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:20 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 Sep 09 03:58:20 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:20 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd 1G" returned: 0 in 0.417s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Downloaded image 9dcce78b-ae53-46a2-a27c-541c9073876f ((None, [{'url': 'file:///opt/stack/data/glance/images/9dcce78b-ae53-46a2-a27c-541c9073876f', 'metadata': {}}])) to volume 780597f2-c3dd-4253-b02e-83d8186dc3fd successfully. {{(pid=87597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Temporary image 9dcce78b-ae53-46a2-a27c-541c9073876f for user 7d41898743b14b5f8817e95b6cb3f6d6 is deleted. {{(pid=87597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.volume.volume_utils [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Marking volume 780597f2-c3dd-4253-b02e-83d8186dc3fd as bootable. {{(pid=87597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Copying metadata from image 9dcce78b-ae53-46a2-a27c-541c9073876f to 780597f2-c3dd-4253-b02e-83d8186dc3fd. {{(pid=87597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 03:58:20 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Creating volume glance metadata for volume 780597f2-c3dd-4253-b02e-83d8186dc3fd backed by image 9dcce78b-ae53-46a2-a27c-541c9073876f with: {'image_id': '9dcce78b-ae53-46a2-a27c-541c9073876f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f672aa5d652ff0d44ade3027cc17dc8c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 03:58:20 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8ea75b-3850-4689-8efa-d274ea7c5616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780597f2-c3dd-4253-b02e-83d8186dc3fd', 'volume_size': 1, 'image_id': '9dcce78b-ae53-46a2-a27c-541c9073876f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dcce78b-ae53-46a2-a27c-541c9073876f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f672aa5d652ff0d44ade3027cc17dc8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8caa34523ea4e229ba2fcdee9d7d22e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd2a191a59fc1f3ac55698ef9921c901dcbcde7901589b1e9ac307be7514e046424357550c1f7fbeefd17a566cd9734a5599b1b133f41c158482cfff5f3715e8', 'id': '9dcce78b-ae53-46a2-a27c-541c9073876f', 'created_at': datetime.datetime(2026, 9, 9, 1, 58, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 1, 58, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dcce78b-ae53-46a2-a27c-541c9073876f/file', 'properties': {}}, 'image_service': }' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5cb1b9-9532-464c-b85b-1c5591df0d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933" returned: 0 in 0.545s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:21 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Volume volume-780597f2-c3dd-4253-b02e-83d8186dc3fd (780597f2-c3dd-4253-b02e-83d8186dc3fd): created successfully Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5cb1b9-9532-464c-b85b-1c5591df0d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:21 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933 Sep 09 03:58:21 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Flow 'volume_create_manager' (0120c7fb-bab5-4db9-975a-b04905315c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:21 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a0f7d260-3c3e-4d42-8568-d92eca8d54c2 tempest-VolumeImageDependencyTests-1024715787 None] Created volume successfully. Sep 09 03:58:21 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300" returned: 0 in 0.489s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:21 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee 1G Sep 09 03:58:21 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:21 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-88f56177-6e8e-4f59-92e4-102ddb794933" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Lock "cinder-quobyte-88f56177-6e8e-4f59-92e4-102ddb794933" released by "delete_volume" :: held 0.938s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Created reservations ['6908eee0-cfc7-4cf0-8b59-f9313c000aad', '9d61a7d1-08fe-40b2-86b1-668af577e7f4', '5854f8c3-ca2e-48db-80b6-c8a9ad6816ef', 'e0878ede-93b4-4e8e-93ee-03f3d32f616b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:21 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:21 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:21 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee 1G" returned: 0 in 0.478s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360bbb68-60d4-40e6-8cc8-ab127021f300 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:21 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360bbb68-60d4-40e6-8cc8-ab127021f300 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee Sep 09 03:58:21 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:21 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:21 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Deleted volume successfully. Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-72f00722-7468-4a17-a90d-78888786f099 tempest-CinderUnicodeTest-544658580 None] Lock "cinder-88f56177-6e8e-4f59-92e4-102ddb794933-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:21 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360bbb68-60d4-40e6-8cc8-ab127021f300 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee" returned: 0 in 0.343s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:21 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee is being set with open permissions: ugo+rw Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Acquiring lock "cinder-780597f2-c3dd-4253-b02e-83d8186dc3fd-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:21 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee Sep 09 03:58:21 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Lock "cinder-780597f2-c3dd-4253-b02e-83d8186dc3fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Acquiring lock "cinder-quobyte-780597f2-c3dd-4253-b02e-83d8186dc3fd" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Lock "cinder-quobyte-780597f2-c3dd-4253-b02e-83d8186dc3fd" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[39340cdb-33e8-48da-afe4-f2bf6de650c6]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:22 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd Sep 09 03:58:22 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:22 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee" returned: 0 in 0.317s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:22 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.info Sep 09 03:58:22 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:22 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd" returned: 0 in 0.419s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:22 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd Sep 09 03:58:22 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:22 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.info" returned: 0 in 0.274s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:22 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.info is being set with open permissions: ugo+rw Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Acquiring lock "cinder-407e013d-1534-4f5f-ab9f-71b0fb2eeb70-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:22 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.info Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-407e013d-1534-4f5f-ab9f-71b0fb2eeb70-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:22 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Acquiring lock "cinder-quobyte-407e013d-1534-4f5f-ab9f-71b0fb2eeb70" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-quobyte-407e013d-1534-4f5f-ab9f-71b0fb2eeb70" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[86377f1a-fbb6-46f9-83b2-3dc792d74bd9]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:22 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-780597f2-c3dd-4253-b02e-83d8186dc3fd" returned: 0 in 0.273s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Lock "cinder-quobyte-780597f2-c3dd-4253-b02e-83d8186dc3fd" released by "delete_volume" :: held 0.738s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:22 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:22 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 Sep 09 03:58:22 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.info" returned: 0 in 0.277s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Created reservations ['3e709cd0-ad9f-471a-9802-d37bbc5b1fc4', '39f8b24e-6296-4db6-8e7f-8bb31202cf25', '48840e14-b9c8-4c20-8a51-ce2482463684', 'd9cd9ce8-a2e5-4a6a-b40f-8cc495f852c1'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:22 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fa1d78b3-c149-4a1a-84bf-48ea16d93ba4 tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:22 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:22 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:23 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70" returned: 0 in 0.391s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:23 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70 Sep 09 03:58:23 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:23 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.261s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:23 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Deleted volume successfully. Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-256ca5c1-b7b6-4e1e-83ed-9109be7ad535 tempest-VolumeImageDependencyTests-1024715787 None] Lock "cinder-780597f2-c3dd-4253-b02e-83d8186dc3fd-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:23 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-407e013d-1534-4f5f-ab9f-71b0fb2eeb70" returned: 0 in 0.276s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-quobyte-407e013d-1534-4f5f-ab9f-71b0fb2eeb70" released by "delete_volume" :: held 0.713s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Created reservations ['6c56e782-621a-4ae0-89e5-9ab2e2b8a868', '77b19404-11bc-4f90-b5de-6e4e94a974e5', '5dc5d398-4b00-40b3-8642-b97926cd6bf4', 'b24cab2b-5cf9-4360-bc7d-8014a22012af'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:23 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:23 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-5a06c5ae-3d08-4e6f-9901-fca003f0cfee-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-5a06c5ae-3d08-4e6f-9901-fca003f0cfee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-360bbb68-60d4-40e6-8cc8-ab127021f300" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-360bbb68-60d4-40e6-8cc8-ab127021f300" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-5a06c5ae-3d08-4e6f-9901-fca003f0cfee" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-5a06c5ae-3d08-4e6f-9901-fca003f0cfee" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot 5a06c5ae-3d08-4e6f-9901-fca003f0cfee of volume 360bbb68-60d4-40e6-8cc8-ab127021f300 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:23 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.342s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:23 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Deleted volume successfully. Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[07afd515-8154-4df9-9011-a5ac2f155da5]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:23 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-317b32c3-a1f0-4a68-9ba5-79d820cb192d tempest-CinderUnicodeTest-544658580 None] Lock "cinder-407e013d-1534-4f5f-ab9f-71b0fb2eeb70-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:24 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee Sep 09 03:58:24 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:24 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee" returned: 0 in 0.414s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:24 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-360bbb68-60d4-40e6-8cc8-ab127021f300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:24 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[96089682-d86d-4655-9a7a-e86289ee1c6e]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:24 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 Sep 09 03:58:24 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:24 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300" returned: 0 in 0.473s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:24 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee Sep 09 03:58:24 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:25 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee" returned: 0 in 0.399s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:25 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee Sep 09 03:58:25 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:25 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300.5a06c5ae-3d08-4e6f-9901-fca003f0cfee" returned: 0 in 0.275s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-5a06c5ae-3d08-4e6f-9901-fca003f0cfee" released by "_delete_snapshot" :: held 1.725s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-360bbb68-60d4-40e6-8cc8-ab127021f300" released by "delete_snapshot" :: held 1.760s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:25 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Created reservations ['fe4f807f-4588-4138-97de-c70b18956e64', 'bb9988eb-be0e-43c8-abe4-4e3e9cae2aaa', 'fc7a2b5d-7fee-4c04-9054-5b6d6be21ccc', 'c4a04cf9-900a-4844-9c35-1dc42c431d05'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:25 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:58:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-fb84cd68-2228-49a0-9b90-5b0554db7227 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-5a06c5ae-3d08-4e6f-9901-fca003f0cfee-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-360bbb68-60d4-40e6-8cc8-ab127021f300-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-360bbb68-60d4-40e6-8cc8-ab127021f300-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-360bbb68-60d4-40e6-8cc8-ab127021f300" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-360bbb68-60d4-40e6-8cc8-ab127021f300" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6e2e1d-fb37-43aa-b4c7-4848fb878ca0]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:26 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 Sep 09 03:58:26 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:26 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300" returned: 0 in 0.430s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:26 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300 Sep 09 03:58:26 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:26 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-360bbb68-60d4-40e6-8cc8-ab127021f300" returned: 0 in 0.276s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-360bbb68-60d4-40e6-8cc8-ab127021f300" released by "delete_volume" :: held 0.782s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:26 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Created reservations ['71d73874-2e58-4a18-87d7-a83513c5d9e2', 'e73ebc6e-4f49-414f-a705-333bcc01054b', '7f00f57d-f762-43a4-bf8c-52c81c723715', 'ba4881c1-d030-4370-8393-f7a15baab948'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:27 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:27 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:27 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.314s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:27 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6d317ba4-f02e-4264-9615-172a034e9624 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-360bbb68-60d4-40e6-8cc8-ab127021f300-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-5ddfaac6-205f-41e3-a2c3-3544f59ad265 tempest-ProjectAdminTests-1676582164 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4433860778809, 'free_capacity_gb': 1773.4433860778809, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87597) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (3fa74d14-f8a6-4f70-864c-59833b90f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5df3e11-76a1-4ffe-830a-049cccc918af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5df3e11-76a1-4ffe-830a-049cccc918af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793672563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39fd3f7-2c0f-4a10-9793-20cade4ee73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:28Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3d69e5-a390-43ed-982c-1c1bdf4af97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3d69e5-a390-43ed-982c-1c1bdf4af97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccc681d-efdf-4c7c-bab6-9749783566b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccc681d-efdf-4c7c-bab6-9749783566b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39fd3f7-2c0f-4a10-9793-20cade4ee73f', 'volume_name': 'volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f943c603-25e0-44fb-858a-572d8db7e51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f943c603-25e0-44fb-858a-572d8db7e51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbd8c19-2741-4431-946e-c927ca8f79c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:27 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Volume a39fd3f7-2c0f-4a10-9793-20cade4ee73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f', 'volume_size': 1} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793672563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39fd3f7-2c0f-4a10-9793-20cade4ee73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:28Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Creating volume a39fd3f7-2c0f-4a10-9793-20cade4ee73f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:27 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:27 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f 1073741824 Sep 09 03:58:27 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:28 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f 1073741824" returned: 0 in 0.496s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:28 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f Sep 09 03:58:28 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:28 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" returned: 0 in 0.316s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbd8c19-2741-4431-946e-c927ca8f79c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5b2eab-8c71-429c-b532-4780f0300021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:28 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Volume volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f (a39fd3f7-2c0f-4a10-9793-20cade4ee73f): created successfully Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5b2eab-8c71-429c-b532-4780f0300021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:28 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (3fa74d14-f8a6-4f70-864c-59833b90f20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:28 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-42265eaa-aa85-4576-9590-d278af484532 tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:58:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:30 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot 70ccbb79-059b-4d86-b453-2e64871b2396 of volume a39fd3f7-2c0f-4a10-9793-20cade4ee73f {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:30 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb95e84-1b1e-466f-8b66-a7ea4c4ff750]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:30 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f Sep 09 03:58:30 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:30 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" returned: 0 in 0.429s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:30 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 1G Sep 09 03:58:30 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:31 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 1G" returned: 0 in 0.489s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:31 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 Sep 09 03:58:31 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:31 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:31 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 is being set with open permissions: ugo+rw Sep 09 03:58:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:31 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 Sep 09 03:58:31 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:31 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396" returned: 0 in 0.288s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:31 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=314,cinder:SELECT=236,cinder:DELETE=28,cinder:INSERT=97 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:58:31 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=235,cinder:UPDATE=320,cinder:INSERT=73,cinder:DELETE=28 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:58:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:31 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.info Sep 09 03:58:31 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:32 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.info" returned: 0 in 0.335s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:32 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.info is being set with open permissions: ugo+rw Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:32 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.info Sep 09 03:58:32 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (ddc2e33a-ae95-4570-914b-b1d64eb837e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56f7931-d7b7-4cb1-8d5a-cddd2db17db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56f7931-d7b7-4cb1-8d5a-cddd2db17db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830169484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f49e17-8b8d-4746-97f7-12086d36abf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:32Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6826343f-e015-44dc-ac56-6595394d2e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6826343f-e015-44dc-ac56-6595394d2e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d630ac75-0c45-4d89-8afb-d1af2018fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d630ac75-0c45-4d89-8afb-d1af2018fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f49e17-8b8d-4746-97f7-12086d36abf3', 'volume_name': 'volume-52f49e17-8b8d-4746-97f7-12086d36abf3', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1c5c41-f566-4300-a3ae-4fea473b3de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1c5c41-f566-4300-a3ae-4fea473b3de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a7669a-7932-465f-a485-072119f0d98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Volume 52f49e17-8b8d-4746-97f7-12086d36abf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f49e17-8b8d-4746-97f7-12086d36abf3', 'volume_size': 1} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:32 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.info" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830169484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f49e17-8b8d-4746-97f7-12086d36abf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:32Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Creating volume 52f49e17-8b8d-4746-97f7-12086d36abf3 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:32 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:32 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 1073741824 Sep 09 03:58:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-eeb30303-094e-4647-b785-0f1a1cb07b17 tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:58:32 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:32 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 1073741824" returned: 0 in 0.451s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:32 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 Sep 09 03:58:32 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:33 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3" returned: 0 in 0.244s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a7669a-7932-465f-a485-072119f0d98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f49e17-8b8d-4746-97f7-12086d36abf3', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633fe02a-7f59-45b1-bf22-aa95266791f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:33 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Volume volume-52f49e17-8b8d-4746-97f7-12086d36abf3 (52f49e17-8b8d-4746-97f7-12086d36abf3): created successfully Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633fe02a-7f59-45b1-bf22-aa95266791f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (ddc2e33a-ae95-4570-914b-b1d64eb837e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:33 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9a1fa901-a78c-4461-842d-b28f232d48e4 tempest-ProjectReaderTests-1142181577 None] Created volume successfully. Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-70ccbb79-059b-4d86-b453-2e64871b2396-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-70ccbb79-059b-4d86-b453-2e64871b2396-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-70ccbb79-059b-4d86-b453-2e64871b2396" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-70ccbb79-059b-4d86-b453-2e64871b2396" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot 70ccbb79-059b-4d86-b453-2e64871b2396 of volume a39fd3f7-2c0f-4a10-9793-20cade4ee73f {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a9ec90-015b-4805-8980-0429ceb3ca6f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:33 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 Sep 09 03:58:33 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:33 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396" returned: 0 in 0.374s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaac00d-2fd2-4345-9841-d01f140c9a6a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:33 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f Sep 09 03:58:33 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:34 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" returned: 0 in 0.360s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:34 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 Sep 09 03:58:34 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:34 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396" returned: 0 in 0.410s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:34 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396 Sep 09 03:58:34 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Creating offline snapshot 90eba653-1257-4f5c-9655-00da40303f97 of volume 52f49e17-8b8d-4746-97f7-12086d36abf3 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dc9640-4729-4e88-8039-62b54f89c643]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:34 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f.70ccbb79-059b-4d86-b453-2e64871b2396" returned: 0 in 0.302s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-70ccbb79-059b-4d86-b453-2e64871b2396" released by "_delete_snapshot" :: held 1.538s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" released by "delete_snapshot" :: held 1.558s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:34 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 Sep 09 03:58:34 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Created reservations ['fd7fe521-753e-4239-9592-1e8b760fc476', '5cb6c4d4-9822-4ffa-88bc-889e31d849b5', '8990e799-3cfd-4517-a197-478cc54fe35b', 'db0924e0-f00b-4bc1-8181-50111fb61dbc'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:34 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:58:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-eefb3849-3f30-48cc-a0b2-ebf75c99607c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-70ccbb79-059b-4d86-b453-2e64871b2396-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:35 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3" returned: 0 in 0.383s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:35 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 1G Sep 09 03:58:35 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-a39fd3f7-2c0f-4a10-9793-20cade4ee73f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-a39fd3f7-2c0f-4a10-9793-20cade4ee73f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:35 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 1G" returned: 0 in 0.481s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f49e17-8b8d-4746-97f7-12086d36abf3 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:35 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f49e17-8b8d-4746-97f7-12086d36abf3 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 Sep 09 03:58:35 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e2b45d-c687-4dff-96e9-fa6bb288635a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:35 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f Sep 09 03:58:35 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:35 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f49e17-8b8d-4746-97f7-12086d36abf3 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97" returned: 0 in 0.337s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:35 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 is being set with open permissions: ugo+rw Sep 09 03:58:35 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:35 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 Sep 09 03:58:35 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:36 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" returned: 0 in 0.425s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:36 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f Sep 09 03:58:36 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:36 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97" returned: 0 in 0.281s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:36 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.info Sep 09 03:58:36 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:36 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" returned: 0 in 0.309s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-a39fd3f7-2c0f-4a10-9793-20cade4ee73f" released by "delete_volume" :: held 0.807s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Created reservations ['2c2ed4f4-6353-417c-a094-f0b0f481444c', 'ac3a01e4-304f-468d-ac61-412b787c223b', '88ab21c4-28b4-47cb-88d0-d7f633ac6241', 'c85a0207-d12d-4b7b-8548-380b2d4520b5'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:36 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.info" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:36 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.info is being set with open permissions: ugo+rw Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:36 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.info Sep 09 03:58:36 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:36 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:36 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:36 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.info" returned: 0 in 0.254s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:36 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-33536a4b-7d07-4c15-8d75-e8a2547cdd5a tempest-ProjectReaderTests-1142181577 None] Create snapshot completed successfully Sep 09 03:58:36 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.280s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:36 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:58:36 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-82e6ab46-fa21-485b-9678-608a0ad91d1c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-a39fd3f7-2c0f-4a10-9793-20cade4ee73f-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (138decdb-2a16-469b-a56a-6bbf69abd3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f0574d-3b30-4c0b-8936-78f493e469c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f0574d-3b30-4c0b-8936-78f493e469c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972963741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b40f150-6375-4792-b4d9-650ac0ef0d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:37Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bb6ac3-1bd6-4bf0-a5b0-0e73be2df28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bb6ac3-1bd6-4bf0-a5b0-0e73be2df28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ce3b4f-50d9-4895-b516-5d89392650de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ce3b4f-50d9-4895-b516-5d89392650de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b40f150-6375-4792-b4d9-650ac0ef0d5a', 'volume_name': 'volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ab0290-e66b-4b31-ae3e-1d13240e59f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ab0290-e66b-4b31-ae3e-1d13240e59f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e66e71-906f-42d9-b237-0bc693f63971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:37 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Volume 4b40f150-6375-4792-b4d9-650ac0ef0d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a', 'volume_size': 1} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972963741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b40f150-6375-4792-b4d9-650ac0ef0d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:37Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Creating volume 4b40f150-6375-4792-b4d9-650ac0ef0d5a {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:37 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:37 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a 1073741824 Sep 09 03:58:37 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:37 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:37 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:37 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.338s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:37 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a 1073741824" returned: 0 in 0.522s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-90eba653-1257-4f5c-9655-00da40303f97-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Lock "cinder-90eba653-1257-4f5c-9655-00da40303f97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-52f49e17-8b8d-4746-97f7-12086d36abf3" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:37 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a Sep 09 03:58:37 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-52f49e17-8b8d-4746-97f7-12086d36abf3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-90eba653-1257-4f5c-9655-00da40303f97" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-90eba653-1257-4f5c-9655-00da40303f97" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Deleting offline snapshot 90eba653-1257-4f5c-9655-00da40303f97 of volume 52f49e17-8b8d-4746-97f7-12086d36abf3 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] snapshot_file for this snap is: volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e240c292-3c36-4e5c-a352-b2361c55e050]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:38 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 Sep 09 03:58:38 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:38 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a" returned: 0 in 0.306s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e66e71-906f-42d9-b237-0bc693f63971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2efc042-bc9c-4b76-9e22-bcc10f31c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:38 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Volume volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a (4b40f150-6375-4792-b4d9-650ac0ef0d5a): created successfully Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2efc042-bc9c-4b76-9e22-bcc10f31c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (138decdb-2a16-469b-a56a-6bbf69abd3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:38 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2e1cb71d-0381-461a-a765-d55ba70e9da1 tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:58:38 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97" returned: 0 in 0.397s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52f49e17-8b8d-4746-97f7-12086d36abf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d72306b-e4aa-4d3d-8a94-05087e8ab57c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:38 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 Sep 09 03:58:38 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:38 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3" returned: 0 in 0.389s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:38 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:38 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 Sep 09 03:58:38 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:39 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97" returned: 0 in 0.379s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:39 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97 Sep 09 03:58:39 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:39 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3.90eba653-1257-4f5c-9655-00da40303f97" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-90eba653-1257-4f5c-9655-00da40303f97" released by "_delete_snapshot" :: held 1.557s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-52f49e17-8b8d-4746-97f7-12086d36abf3" released by "delete_snapshot" :: held 1.580s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot a7ce2892-ff75-4697-ae47-b38654635cad of volume 4b40f150-6375-4792-b4d9-650ac0ef0d5a {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[759a949d-21c4-4fbe-9f29-f129422940b8]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Created reservations ['0e6c084b-f2aa-44a4-b873-a06152c69337', '7527ac44-7739-4bde-a9c4-8cbf20769cc5', 'b2dd4996-79c8-4862-b273-0c3762619fa4', 'e1ff2cb5-54b1-4184-b7ce-1185e9c3c599'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:39 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a Sep 09 03:58:39 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:39 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Delete snapshot completed successfully. Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31b397b9-7873-4726-a2ec-b0dad62170ac tempest-ProjectReaderTests-1142181577 None] Lock "cinder-90eba653-1257-4f5c-9655-00da40303f97-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:39 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a" returned: 0 in 0.443s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:39 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-52f49e17-8b8d-4746-97f7-12086d36abf3-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:39 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad 1G Sep 09 03:58:39 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-52f49e17-8b8d-4746-97f7-12086d36abf3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-52f49e17-8b8d-4746-97f7-12086d36abf3" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-52f49e17-8b8d-4746-97f7-12086d36abf3" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17b0cce-5b30-4197-a98a-a7b4216119bf]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:40 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 Sep 09 03:58:40 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:40 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad 1G" returned: 0 in 0.442s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:40 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad Sep 09 03:58:40 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:40 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3" returned: 0 in 0.420s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:40 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3 Sep 09 03:58:40 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:40 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad" returned: 0 in 0.344s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:40 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad is being set with open permissions: ugo+rw Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:40 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad Sep 09 03:58:40 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:40 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f49e17-8b8d-4746-97f7-12086d36abf3" returned: 0 in 0.252s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-52f49e17-8b8d-4746-97f7-12086d36abf3" released by "delete_volume" :: held 0.745s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Created reservations ['d28b12ef-8c91-4d62-b9cb-2af6d8ca00d2', '7d8931ce-1a6b-492b-95b8-466cb9d8248d', '87a35db7-12d7-4148-b982-37b7dda7a4eb', '068fb432-7c9a-41bc-9b7d-9661c3488cff'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:40 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:40 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:40 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:41 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad" returned: 0 in 0.287s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:41 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.info Sep 09 03:58:41 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:41 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.289s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Deleted volume successfully. Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3d38d8fe-584e-48d8-8932-347c2a9b20a2 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-52f49e17-8b8d-4746-97f7-12086d36abf3-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:41 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.info" returned: 0 in 0.312s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:41 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.info is being set with open permissions: ugo+rw Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:41 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.info Sep 09 03:58:41 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:41 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.info" returned: 0 in 0.307s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:41 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-5ca1ec36-897b-48dc-96c0-7be4236faca6 tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:41 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (6fb2322d-fdb3-419f-ba13-b537e726b36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc65e46-5c62-4c26-933a-315a4d64bfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc65e46-5c62-4c26-933a-315a4d64bfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-151938208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bce52d5-31ef-480c-83a7-0628effbc7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:42Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55396014-53be-4503-bdcc-509575e63e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55396014-53be-4503-bdcc-509575e63e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1510382-469f-4933-8114-ce4537464c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1510382-469f-4933-8114-ce4537464c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bce52d5-31ef-480c-83a7-0628effbc7c8', 'volume_name': 'volume-1bce52d5-31ef-480c-83a7-0628effbc7c8', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fa6832-65b0-43f8-8682-93368efed779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fa6832-65b0-43f8-8682-93368efed779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f71aed-c141-489c-870e-7cee7d77d34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Volume 1bce52d5-31ef-480c-83a7-0628effbc7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bce52d5-31ef-480c-83a7-0628effbc7c8', 'volume_size': 1} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-151938208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bce52d5-31ef-480c-83a7-0628effbc7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:42Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Creating volume 1bce52d5-31ef-480c-83a7-0628effbc7c8 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:42 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:42 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 1073741824 Sep 09 03:58:42 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Flow 'volume_create_manager' (f19a408b-3128-42c8-bcca-6d05622bb52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2400d82-7585-4ed9-ac36-813b543904b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2400d82-7585-4ed9-ac36-813b543904b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546908440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1501b405-4c2c-4319-98cb-61b0ba8f542c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee31fefe09114c62b2342e4295e074fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:42Z,use_quota=True,user_id='63097c18a2874a3981c798524fdcc8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e001375d-9e1a-4d89-8595-1f2069162b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e001375d-9e1a-4d89-8595-1f2069162b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b5459d-ff55-48ce-b018-d1b86d4e34ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b5459d-ff55-48ce-b018-d1b86d4e34ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1501b405-4c2c-4319-98cb-61b0ba8f542c', 'volume_name': 'volume-1501b405-4c2c-4319-98cb-61b0ba8f542c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5143f0b0-793b-4a56-b9c4-0eb9e43df1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5143f0b0-793b-4a56-b9c4-0eb9e43df1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12b4ef1-35fe-4943-bcc6-dfada771e876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Volume 1501b405-4c2c-4319-98cb-61b0ba8f542c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1501b405-4c2c-4319-98cb-61b0ba8f542c', 'volume_size': 1} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:42 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 1073741824" returned: 0 in 0.439s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:42 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 Sep 09 03:58:42 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-a7ce2892-ff75-4697-ae47-b38654635cad-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Lock "cinder-a7ce2892-ff75-4697-ae47-b38654635cad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-4b40f150-6375-4792-b4d9-650ac0ef0d5a" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-4b40f150-6375-4792-b4d9-650ac0ef0d5a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-a7ce2892-ff75-4697-ae47-b38654635cad" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-a7ce2892-ff75-4697-ae47-b38654635cad" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot a7ce2892-ff75-4697-ae47-b38654635cad of volume 4b40f150-6375-4792-b4d9-650ac0ef0d5a {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d41d31-0af0-4e6d-bbb8-605fa3c101be]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:42 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8" returned: 0 in 0.254s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.631s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546908440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1501b405-4c2c-4319-98cb-61b0ba8f542c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee31fefe09114c62b2342e4295e074fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:42Z,use_quota=True,user_id='63097c18a2874a3981c798524fdcc8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Creating volume 1501b405-4c2c-4319-98cb-61b0ba8f542c {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:42 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f71aed-c141-489c-870e-7cee7d77d34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bce52d5-31ef-480c-83a7-0628effbc7c8', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c 1073741824 Sep 09 03:58:42 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fb6031-6b21-4c37-a6f6-672fbc26529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:42 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Volume volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 (1bce52d5-31ef-480c-83a7-0628effbc7c8): created successfully Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fb6031-6b21-4c37-a6f6-672fbc26529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:42 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (6fb2322d-fdb3-419f-ba13-b537e726b36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:42 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1767a22d-08fd-4230-8571-9d20a3845bb9 tempest-ProjectReaderTests-1142181577 None] Created volume successfully. Sep 09 03:58:42 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad Sep 09 03:58:42 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:43 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad" returned: 0 in 0.392s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bed7bf-d881-499d-b745-85f6ecc54494]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:43 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c 1073741824" returned: 0 in 0.432s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:43 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a Sep 09 03:58:43 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:43 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c Sep 09 03:58:43 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:43 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c" returned: 0 in 0.244s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:43 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12b4ef1-35fe-4943-bcc6-dfada771e876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1501b405-4c2c-4319-98cb-61b0ba8f542c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136b2d99-1897-40e8-a137-d2298e908292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a" returned: 0 in 0.392s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:43 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Volume volume-1501b405-4c2c-4319-98cb-61b0ba8f542c (1501b405-4c2c-4319-98cb-61b0ba8f542c): created successfully Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136b2d99-1897-40e8-a137-d2298e908292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:43 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad Sep 09 03:58:43 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:43 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Flow 'volume_create_manager' (f19a408b-3128-42c8-bcca-6d05622bb52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:43 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d05959fd-433c-4557-8da5-bc5d368f1c46 tempest-ProjectReaderTests-1839840107 None] Created volume successfully. Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:44 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad" returned: 0 in 0.411s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Creating offline snapshot 6cf28c31-d359-431d-b726-2ba3fdcdcc48 of volume 1bce52d5-31ef-480c-83a7-0628effbc7c8 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:44 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad Sep 09 03:58:44 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b07b3-2f7e-4235-9132-d67add75761d]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Acquiring lock "cinder-1501b405-4c2c-4319-98cb-61b0ba8f542c-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Lock "cinder-1501b405-4c2c-4319-98cb-61b0ba8f542c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Acquiring lock "cinder-quobyte-1501b405-4c2c-4319-98cb-61b0ba8f542c" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Lock "cinder-quobyte-1501b405-4c2c-4319-98cb-61b0ba8f542c" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:44 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 Sep 09 03:58:44 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a489f75-a124-4e62-8af8-d10ed39d91ad]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:44 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a.a7ce2892-ff75-4697-ae47-b38654635cad" returned: 0 in 0.277s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:44 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c Sep 09 03:58:44 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-a7ce2892-ff75-4697-ae47-b38654635cad" released by "_delete_snapshot" :: held 1.581s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-4b40f150-6375-4792-b4d9-650ac0ef0d5a" released by "delete_snapshot" :: held 1.608s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Created reservations ['c50c4646-7323-4a11-832c-b652284fafb5', '6d2e1179-8b0b-4744-99a4-b37f4e4ee0a2', '5fc4c6ed-9f28-48d1-b2c2-35f20e744258', 'd9de4e0a-9a00-4e00-9ad9-767f46a8de9b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:44 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-9447af86-af4b-45ff-8484-4560049023cf tempest-ProjectMemberTests-1166415715 None] Lock "cinder-a7ce2892-ff75-4697-ae47-b38654635cad-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:44 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8" returned: 0 in 0.428s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:44 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 1G Sep 09 03:58:44 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:44 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c" returned: 0 in 0.381s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:44 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c Sep 09 03:58:44 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-4b40f150-6375-4792-b4d9-650ac0ef0d5a-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:44 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1501b405-4c2c-4319-98cb-61b0ba8f542c" returned: 0 in 0.280s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-4b40f150-6375-4792-b4d9-650ac0ef0d5a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Lock "cinder-quobyte-1501b405-4c2c-4319-98cb-61b0ba8f542c" released by "delete_volume" :: held 0.725s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-4b40f150-6375-4792-b4d9-650ac0ef0d5a" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:44 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 1G" returned: 0 in 0.471s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:44 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-4b40f150-6375-4792-b4d9-650ac0ef0d5a" acquired by "delete_volume" :: waited 0.032s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:44 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 Sep 09 03:58:44 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2a532-0182-42f8-a608-f5b1ac235999]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Created reservations ['b757edf5-c9be-4a40-bc41-7b7b592bbc38', 'b9341054-ff26-437a-9cf2-5e2d20415cdd', '38be040f-fa7e-464e-bb07-4d72d3fb8339', '3bc95f4b-4dfe-4b76-89fe-9effd6ef4bf2'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:45 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a Sep 09 03:58:45 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:45 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:45 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:45 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48" returned: 0 in 0.348s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:45 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 is being set with open permissions: ugo+rw Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:45 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 Sep 09 03:58:45 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:45 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a" returned: 0 in 0.499s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:45 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.385s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:45 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Deleted volume successfully. Sep 09 03:58:45 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a Sep 09 03:58:45 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-1f886da5-9950-4336-9993-95978a292cba tempest-ProjectReaderTests-1839840107 None] Lock "cinder-1501b405-4c2c-4319-98cb-61b0ba8f542c-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:45 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48" returned: 0 in 0.413s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:45 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.info Sep 09 03:58:45 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:45 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Flow 'volume_create_manager' (dc104702-9498-4ec3-b85e-c715140914e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f5251f-7c04-4f42-abc4-91f43874349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4b40f150-6375-4792-b4d9-650ac0ef0d5a" returned: 0 in 0.321s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f5251f-7c04-4f42-abc4-91f43874349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971707020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94bd127-7e1d-420c-8109-fcd6447b68d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee31fefe09114c62b2342e4295e074fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:46Z,use_quota=True,user_id='63097c18a2874a3981c798524fdcc8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbe0ac8-7b37-4f74-b9a8-48c549dd93c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbbe0ac8-7b37-4f74-b9a8-48c549dd93c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd2a1fa-7c86-491e-90bc-4a997a2e89c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd2a1fa-7c86-491e-90bc-4a997a2e89c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94bd127-7e1d-420c-8109-fcd6447b68d8', 'volume_name': 'volume-d94bd127-7e1d-420c-8109-fcd6447b68d8', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e4bf51-a60f-48ec-83c7-9d6a72933b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e4bf51-a60f-48ec-83c7-9d6a72933b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc43169-30fc-4978-8725-35cc6a72c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:45 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Volume d94bd127-7e1d-420c-8109-fcd6447b68d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94bd127-7e1d-420c-8109-fcd6447b68d8', 'volume_size': 1} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-4b40f150-6375-4792-b4d9-650ac0ef0d5a" released by "delete_volume" :: held 0.952s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:45 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Created reservations ['9eed83cb-31a2-4661-8e45-fe75f1d814f6', '656d723f-906a-4e5d-923a-c907266b6c32', '966fee7e-be60-473b-8d6b-82cd132e2571', '1212d169-b6e6-4a5f-91fd-6d5b897260fe'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:46 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.info" returned: 0 in 0.280s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:46 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.info is being set with open permissions: ugo+rw Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:46 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.info Sep 09 03:58:46 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:46 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:46 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:46 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.info" returned: 0 in 0.245s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971707020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94bd127-7e1d-420c-8109-fcd6447b68d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee31fefe09114c62b2342e4295e074fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:46Z,use_quota=True,user_id='63097c18a2874a3981c798524fdcc8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Creating volume d94bd127-7e1d-420c-8109-fcd6447b68d8 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:46 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:46 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:46 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 1073741824 Sep 09 03:58:46 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:58:46 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6799a872-5d28-434e-98db-33c413eb6b7c tempest-ProjectReaderTests-1142181577 None] Create snapshot completed successfully Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-41169508-fde3-4cb4-a27b-6f27d4703496 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-4b40f150-6375-4792-b4d9-650ac0ef0d5a-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:46 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 1073741824" returned: 0 in 0.471s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:46 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:46 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 Sep 09 03:58:46 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:47 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8" returned: 0 in 0.278s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc43169-30fc-4978-8725-35cc6a72c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94bd127-7e1d-420c-8109-fcd6447b68d8', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e800bae-6451-453c-9563-d1f9cb4f4915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Volume volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 (d94bd127-7e1d-420c-8109-fcd6447b68d8): created successfully Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e800bae-6451-453c-9563-d1f9cb4f4915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Flow 'volume_create_manager' (dc104702-9498-4ec3-b85e-c715140914e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:47 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-856b9a04-2498-44cb-accb-7bf3820b4d23 tempest-ProjectReaderTests-1839840107 None] Created volume successfully. Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-6cf28c31-d359-431d-b726-2ba3fdcdcc48-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-6cf28c31-d359-431d-b726-2ba3fdcdcc48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-1bce52d5-31ef-480c-83a7-0628effbc7c8" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-1bce52d5-31ef-480c-83a7-0628effbc7c8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-6cf28c31-d359-431d-b726-2ba3fdcdcc48" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-6cf28c31-d359-431d-b726-2ba3fdcdcc48" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Deleting offline snapshot 6cf28c31-d359-431d-b726-2ba3fdcdcc48 of volume 1bce52d5-31ef-480c-83a7-0628effbc7c8 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] snapshot_file for this snap is: volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece10a03-5dd5-49bf-983d-845383960e81]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:47 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 Sep 09 03:58:47 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (d8f50042-59fc-41c0-a354-ced69c022f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8e85af-4441-4396-98a8-402f0a714b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8e85af-4441-4396-98a8-402f0a714b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784901967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f7b20e-ba79-4a06-8df4-b3ecbd36ff91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:48Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87263b4-a7a4-448b-b98b-2133d18dcb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87263b4-a7a4-448b-b98b-2133d18dcb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70843f0-611e-4749-8703-e8f6aaaf55b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70843f0-611e-4749-8703-e8f6aaaf55b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f7b20e-ba79-4a06-8df4-b3ecbd36ff91', 'volume_name': 'volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab791e0-f941-4dc1-8d8a-b40e45f814e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab791e0-f941-4dc1-8d8a-b40e45f814e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:47 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76f5b5d-2721-449c-bb68-224aa01c09bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:47 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Volume 52f7b20e-ba79-4a06-8df4-b3ecbd36ff91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91', 'volume_size': 1} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784901967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f7b20e-ba79-4a06-8df4-b3ecbd36ff91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:48Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Creating volume 52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:47 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48" returned: 0 in 0.398s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bce52d5-31ef-480c-83a7-0628effbc7c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:47 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 1073741824 Sep 09 03:58:47 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b59432-d708-4127-9392-031f51797c00]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:47 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:47 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 Sep 09 03:58:47 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Acquiring lock "cinder-d94bd127-7e1d-420c-8109-fcd6447b68d8-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Lock "cinder-d94bd127-7e1d-420c-8109-fcd6447b68d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Acquiring lock "cinder-quobyte-d94bd127-7e1d-420c-8109-fcd6447b68d8" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Lock "cinder-quobyte-d94bd127-7e1d-420c-8109-fcd6447b68d8" acquired by "delete_volume" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a69e0-e08a-4ddc-adc9-577138f51188]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:48 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 1073741824" returned: 0 in 0.470s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:48 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8" returned: 0 in 0.438s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:48 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 Sep 09 03:58:48 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:48 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 Sep 09 03:58:48 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:48 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 Sep 09 03:58:48 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:48 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:48 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" returned: 0 in 0.278s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8" returned: 0 in 0.394s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76f5b5d-2721-449c-bb68-224aa01c09bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c69c236-3ac4-41d6-84be-4ffbe1207e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:48 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8 Sep 09 03:58:48 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:48 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48" returned: 0 in 0.367s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:48 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Volume volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 (52f7b20e-ba79-4a06-8df4-b3ecbd36ff91): created successfully Sep 09 03:58:48 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48 Sep 09 03:58:48 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c69c236-3ac4-41d6-84be-4ffbe1207e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (d8f50042-59fc-41c0-a354-ced69c022f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:48 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-bb1b2c5b-460f-4e83-97c6-19ad9151ed63 tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:58:48 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-d94bd127-7e1d-420c-8109-fcd6447b68d8" returned: 0 in 0.287s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Lock "cinder-quobyte-d94bd127-7e1d-420c-8109-fcd6447b68d8" released by "delete_volume" :: held 0.724s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:48 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8.6cf28c31-d359-431d-b726-2ba3fdcdcc48" returned: 0 in 0.265s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-6cf28c31-d359-431d-b726-2ba3fdcdcc48" released by "_delete_snapshot" :: held 1.573s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-1bce52d5-31ef-480c-83a7-0628effbc7c8" released by "delete_snapshot" :: held 1.607s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Created reservations ['bf84b143-9a80-4018-9987-bdaa25b2b781', '70ec14e3-eab5-4de4-8e59-c6960f03792d', 'c5c2732e-a047-4178-b453-fdd3a13f332d', 'b0e2757d-b8a3-42e6-a7fa-02e0027be709'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Created reservations ['53280169-5016-4c37-b19d-597be4238c41', '6fb49fb7-51dc-492c-9195-a74105c60e9f', 'a5dd7508-23a7-4968-bc16-dc458210502f', '071af833-7cbf-4254-b89c-fa09df6b7df4'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:48 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:49 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:49 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Delete snapshot completed successfully. Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-05d2f93a-01d1-4e52-801f-1febf9b2b279 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-6cf28c31-d359-431d-b726-2ba3fdcdcc48-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:49 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.258s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:49 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Deleted volume successfully. Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a80acfd9-3d65-472d-a3f0-9420e7635f1d tempest-ProjectReaderTests-1839840107 None] Lock "cinder-d94bd127-7e1d-420c-8109-fcd6447b68d8-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-1bce52d5-31ef-480c-83a7-0628effbc7c8-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Lock "cinder-1bce52d5-31ef-480c-83a7-0628effbc7c8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-1bce52d5-31ef-480c-83a7-0628effbc7c8" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-1bce52d5-31ef-480c-83a7-0628effbc7c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4db6ac8-05c0-4803-b533-2cee65705da3]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:49 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:49 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 Sep 09 03:58:49 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Flow 'volume_create_manager' (079edaaf-6100-4599-b929-b9c34dd4ed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a71a1b-d2f0-46d8-8866-0052ff102197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a71a1b-d2f0-46d8-8866-0052ff102197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-819461462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4258b329-b20e-4cd1-831a-438cd77a2948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee31fefe09114c62b2342e4295e074fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:50Z,use_quota=True,user_id='63097c18a2874a3981c798524fdcc8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2a24fc-00ba-4979-8152-ac799761cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2a24fc-00ba-4979-8152-ac799761cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45736478-8136-4d9a-a49f-460032537180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45736478-8136-4d9a-a49f-460032537180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4258b329-b20e-4cd1-831a-438cd77a2948', 'volume_name': 'volume-4258b329-b20e-4cd1-831a-438cd77a2948', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a0ea15-2b0a-4fab-ab0d-aafc8af9f2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a0ea15-2b0a-4fab-ab0d-aafc8af9f2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af093bc-72c5-43dd-88a7-6ce89b42d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:50 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Volume 4258b329-b20e-4cd1-831a-438cd77a2948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4258b329-b20e-4cd1-831a-438cd77a2948', 'volume_size': 1} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot 7a1abd36-d13a-4c80-a261-45a8e2a96784 of volume 52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c4f65e-46c5-408e-b63f-3ccda5332644]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:50 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8" returned: 0 in 0.454s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:50 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8 Sep 09 03:58:50 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:50 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 Sep 09 03:58:50 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:50 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-1bce52d5-31ef-480c-83a7-0628effbc7c8" returned: 0 in 0.245s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-1bce52d5-31ef-480c-83a7-0628effbc7c8" released by "delete_volume" :: held 0.765s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Created reservations ['e0957e96-d2cc-45ff-bd6e-29ec2a7b8247', '803728b2-ec9c-41d5-8d3d-10628e3644a9', 'df27b46d-c984-4a1b-9012-0080b5594e9a', '0e9df342-d192-40c0-b62b-92932ad8b33e'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:50 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" returned: 0 in 0.381s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:50 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 1G Sep 09 03:58:50 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:50 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:50 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:50 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.250s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:50 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Deleted volume successfully. Sep 09 03:58:50 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-dbd07237-2599-41d4-84a3-96f3ea67d21c tempest-ProjectReaderTests-1142181577 None] Lock "cinder-1bce52d5-31ef-480c-83a7-0628effbc7c8-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:51 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 1G" returned: 0 in 0.418s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:51 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 Sep 09 03:58:51 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:51 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784" returned: 0 in 0.274s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:51 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 is being set with open permissions: ugo+rw Sep 09 03:58:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:51 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 Sep 09 03:58:51 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:51 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784" returned: 0 in 0.261s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:51 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.info Sep 09 03:58:51 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:51 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.info" returned: 0 in 0.252s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:51 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.info is being set with open permissions: ugo+rw Sep 09 03:58:51 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:51 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.info Sep 09 03:58:51 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:52 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.info" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-819461462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4258b329-b20e-4cd1-831a-438cd77a2948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee31fefe09114c62b2342e4295e074fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:50Z,use_quota=True,user_id='63097c18a2874a3981c798524fdcc8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Creating volume 4258b329-b20e-4cd1-831a-438cd77a2948 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:52 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:52 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 1073741824 Sep 09 03:58:52 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-1fc8c8de-e318-4855-a135-d3c05a0b92c0 tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (11413008-c858-4041-86aa-26d2fc328c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9ba595-a2de-4c78-8d18-098423a1bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9ba595-a2de-4c78-8d18-098423a1bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856683697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2074f057-01d8-49ac-ba84-82e30f67ef38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:52Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82b40fb-3da5-40b9-8950-cac508326414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82b40fb-3da5-40b9-8950-cac508326414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e162d08d-dcee-434d-b657-bfc9e3e23614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e162d08d-dcee-434d-b657-bfc9e3e23614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2074f057-01d8-49ac-ba84-82e30f67ef38', 'volume_name': 'volume-2074f057-01d8-49ac-ba84-82e30f67ef38', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e03588-e7ca-4e26-b077-e3fdf8471260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e03588-e7ca-4e26-b077-e3fdf8471260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8649cb41-107a-485e-a8dd-1f5066aff6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:52 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Volume 2074f057-01d8-49ac-ba84-82e30f67ef38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2074f057-01d8-49ac-ba84-82e30f67ef38', 'volume_size': 1} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:52 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 1073741824" returned: 0 in 0.434s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:52 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 Sep 09 03:58:52 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:52 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948" returned: 0 in 0.248s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856683697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2074f057-01d8-49ac-ba84-82e30f67ef38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:52Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Creating volume 2074f057-01d8-49ac-ba84-82e30f67ef38 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:52 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af093bc-72c5-43dd-88a7-6ce89b42d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4258b329-b20e-4cd1-831a-438cd77a2948', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4e9b16-a43b-4b61-a6f2-0ec127269362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:52 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 1073741824 Sep 09 03:58:52 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:52 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Volume volume-4258b329-b20e-4cd1-831a-438cd77a2948 (4258b329-b20e-4cd1-831a-438cd77a2948): created successfully Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4e9b16-a43b-4b61-a6f2-0ec127269362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:52 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Flow 'volume_create_manager' (079edaaf-6100-4599-b929-b9c34dd4ed58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:52 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-26ae6321-fbd8-42c7-a5a7-03a71c2da05a tempest-ProjectReaderTests-1839840107 None] Created volume successfully. Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-7a1abd36-d13a-4c80-a261-45a8e2a96784-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Lock "cinder-7a1abd36-d13a-4c80-a261-45a8e2a96784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-7a1abd36-d13a-4c80-a261-45a8e2a96784" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-7a1abd36-d13a-4c80-a261-45a8e2a96784" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot 7a1abd36-d13a-4c80-a261-45a8e2a96784 of volume 52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Acquiring lock "cinder-4258b329-b20e-4cd1-831a-438cd77a2948-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[88872529-f93b-4d7b-b35e-5380edf5a901]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Lock "cinder-4258b329-b20e-4cd1-831a-438cd77a2948-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:53 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 1073741824" returned: 0 in 0.551s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Acquiring lock "cinder-quobyte-4258b329-b20e-4cd1-831a-438cd77a2948" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Lock "cinder-quobyte-4258b329-b20e-4cd1-831a-438cd77a2948" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[715f9a45-9f21-43c6-8b4e-32e44fa4a7f3]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:53 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 Sep 09 03:58:53 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:53 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 Sep 09 03:58:53 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:53 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 Sep 09 03:58:53 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:53 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38" returned: 0 in 0.270s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:53 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784" returned: 0 in 0.397s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8649cb41-107a-485e-a8dd-1f5066aff6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2074f057-01d8-49ac-ba84-82e30f67ef38', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2f05d7-98ea-4db4-81fb-ec141c452acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cfb0f5-fe39-4f99-b6af-8dcd0d64f6d3]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:53 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Volume volume-2074f057-01d8-49ac-ba84-82e30f67ef38 (2074f057-01d8-49ac-ba84-82e30f67ef38): created successfully Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2f05d7-98ea-4db4-81fb-ec141c452acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (11413008-c858-4041-86aa-26d2fc328c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:53 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-db478d0d-0b34-45b3-b25b-f6c038807f18 tempest-ProjectReaderTests-1142181577 None] Created volume successfully. Sep 09 03:58:53 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948" returned: 0 in 0.404s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:53 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:53 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948 Sep 09 03:58:53 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:53 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 Sep 09 03:58:53 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:54 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:54 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-4258b329-b20e-4cd1-831a-438cd77a2948" returned: 0 in 0.281s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" returned: 0 in 0.378s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Lock "cinder-quobyte-4258b329-b20e-4cd1-831a-438cd77a2948" released by "delete_volume" :: held 0.740s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:54 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 Sep 09 03:58:54 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Created reservations ['c0162927-165c-4ed8-bc75-a2d8175d54f1', '1d57163a-ee72-4f0f-9ba0-1bfbe5c99551', '43088523-5364-42bf-ace7-29c62fb5de17', 'db72e911-7675-486b-994a-10ab2e109e4c'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:54 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:54 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Creating offline snapshot 22700452-8de1-4a6e-9738-6f1e330a8404 of volume 2074f057-01d8-49ac-ba84-82e30f67ef38 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a10636-01d6-4c7c-be0a-672761f2f471]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:54 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784" returned: 0 in 0.399s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:54 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784 Sep 09 03:58:54 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:54 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 Sep 09 03:58:54 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:54 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:54 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Deleted volume successfully. Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-98e0d293-8c1f-47f2-ab33-7129eeec4dbb tempest-ProjectReaderTests-1839840107 None] Lock "cinder-4258b329-b20e-4cd1-831a-438cd77a2948-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:54 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91.7a1abd36-d13a-4c80-a261-45a8e2a96784" returned: 0 in 0.340s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-7a1abd36-d13a-4c80-a261-45a8e2a96784" released by "_delete_snapshot" :: held 1.632s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:54 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38" returned: 0 in 0.432s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:54 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" released by "delete_snapshot" :: held 1.668s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:55 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 1G Sep 09 03:58:55 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Created reservations ['83e88498-93cb-432e-9d1d-e8696cea2cb0', '9688d149-b1d1-4110-bb5d-6f17bb4017ae', '885495a3-e052-42e6-805b-efb39e560ce6', '8609004a-b4a6-4112-bc43-89eb88307a60'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Flow 'volume_create_manager' (7b85e7fb-595d-4f28-819b-e02b3ad456fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863e6b0b-c493-4107-87af-53154b7854c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863e6b0b-c493-4107-87af-53154b7854c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761575416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe2b05d-18cd-421b-812f-4a2428a15957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee31fefe09114c62b2342e4295e074fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:55Z,use_quota=True,user_id='63097c18a2874a3981c798524fdcc8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bb44b4-eb6d-49f2-9cf8-63e1658ec715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bb44b4-eb6d-49f2-9cf8-63e1658ec715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e34cb03-f7c8-4e37-ac9c-87bbf28f0914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e34cb03-f7c8-4e37-ac9c-87bbf28f0914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe2b05d-18cd-421b-812f-4a2428a15957', 'volume_name': 'volume-8fe2b05d-18cd-421b-812f-4a2428a15957', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fc94f6-7019-464d-bba8-22294d68c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fc94f6-7019-464d-bba8-22294d68c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de524c3-63d9-44ca-ace0-52033e206f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:55 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Volume 8fe2b05d-18cd-421b-812f-4a2428a15957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe2b05d-18cd-421b-812f-4a2428a15957', 'volume_size': 1} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:55 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-64e793bf-f46a-4fce-9694-dce76a6c2b6a tempest-ProjectMemberTests-1166415715 None] Lock "cinder-7a1abd36-d13a-4c80-a261-45a8e2a96784-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:55 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 1G" returned: 0 in 0.411s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2074f057-01d8-49ac-ba84-82e30f67ef38 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:55 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2074f057-01d8-49ac-ba84-82e30f67ef38 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 Sep 09 03:58:55 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a26c6e8-85be-4fb5-bb71-a64a28b9b2e9]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:55 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2074f057-01d8-49ac-ba84-82e30f67ef38 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404" returned: 0 in 0.324s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:55 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 is being set with open permissions: ugo+rw Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:55 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 Sep 09 03:58:55 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:55 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 Sep 09 03:58:55 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:55 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404" returned: 0 in 0.238s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:55 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:56 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" returned: 0 in 0.397s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:56 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.info Sep 09 03:58:56 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:56 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91 Sep 09 03:58:56 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:56 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" returned: 0 in 0.238s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:56 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.info" returned: 0 in 0.276s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:56 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.info is being set with open permissions: ugo+rw Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91" released by "delete_volume" :: held 0.702s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:56 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.info Sep 09 03:58:56 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Created reservations ['2023b3ac-ca17-4892-9d96-ea230ed8566d', '8dbb2b7e-af55-4b07-bbee-e62b4442f49d', '6bdea87f-a1b4-4b28-9dac-3acbe9949f8d', 'd1c717bf-d805-4137-a8f1-3d63cb06eda2'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:56 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:56 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:56 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.info" returned: 0 in 0.250s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761575416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe2b05d-18cd-421b-812f-4a2428a15957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee31fefe09114c62b2342e4295e074fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:55Z,use_quota=True,user_id='63097c18a2874a3981c798524fdcc8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Creating volume 8fe2b05d-18cd-421b-812f-4a2428a15957 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:56 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:56 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 1073741824 Sep 09 03:58:56 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3cbd0441-ec11-45d9-bc68-deb69f4096cf tempest-ProjectReaderTests-1142181577 None] Create snapshot completed successfully Sep 09 03:58:56 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.293s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:56 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:58:56 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-14deb26c-9da7-4455-96ca-8a83ad6cc3e1 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-52f7b20e-ba79-4a06-8df4-b3ecbd36ff91-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:57 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 1073741824" returned: 0 in 0.466s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:57 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 Sep 09 03:58:57 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (8471a408-5a94-4db1-a795-518b3476d55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2581ed-69c5-4fbd-b7c0-c6b332e2b677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2581ed-69c5-4fbd-b7c0-c6b332e2b677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213122472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93f19e9-586c-40ce-8957-546f1ff10a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:57Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4921222-72c3-4178-81c5-c11d66f30af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4921222-72c3-4178-81c5-c11d66f30af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de334dce-b184-47dd-abe2-be191c8a43a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de334dce-b184-47dd-abe2-be191c8a43a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93f19e9-586c-40ce-8957-546f1ff10a67', 'volume_name': 'volume-e93f19e9-586c-40ce-8957-546f1ff10a67', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83d7f3e-53cf-4b2c-a566-1f9b44ed8f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83d7f3e-53cf-4b2c-a566-1f9b44ed8f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08726a98-af85-41a0-a09c-e52d92f4bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:57 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Volume e93f19e9-586c-40ce-8957-546f1ff10a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93f19e9-586c-40ce-8957-546f1ff10a67', 'volume_size': 1} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:57 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957" returned: 0 in 0.266s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213122472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93f19e9-586c-40ce-8957-546f1ff10a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:58:57Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Creating volume e93f19e9-586c-40ce-8957-546f1ff10a67 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:58:57 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de524c3-63d9-44ca-ace0-52033e206f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe2b05d-18cd-421b-812f-4a2428a15957', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f456046-4900-44b0-a331-92f170a4b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:57 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 1073741824 Sep 09 03:58:57 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:57 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Volume volume-8fe2b05d-18cd-421b-812f-4a2428a15957 (8fe2b05d-18cd-421b-812f-4a2428a15957): created successfully Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f456046-4900-44b0-a331-92f170a4b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Flow 'volume_create_manager' (7b85e7fb-595d-4f28-819b-e02b3ad456fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:57 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8bba437a-1b08-4713-b8ca-b4884f369e38 tempest-ProjectReaderTests-1839840107 None] Created volume successfully. Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-22700452-8de1-4a6e-9738-6f1e330a8404-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Lock "cinder-22700452-8de1-4a6e-9738-6f1e330a8404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-2074f057-01d8-49ac-ba84-82e30f67ef38" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-2074f057-01d8-49ac-ba84-82e30f67ef38" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-22700452-8de1-4a6e-9738-6f1e330a8404" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-22700452-8de1-4a6e-9738-6f1e330a8404" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Deleting offline snapshot 22700452-8de1-4a6e-9738-6f1e330a8404 of volume 2074f057-01d8-49ac-ba84-82e30f67ef38 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:58:57 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] snapshot_file for this snap is: volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 1073741824" returned: 0 in 0.491s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d464312-2bf5-41d7-81a8-199b6f6b91a4]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:57 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 Sep 09 03:58:57 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:57 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 Sep 09 03:58:57 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:58 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67" returned: 0 in 0.265s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08726a98-af85-41a0-a09c-e52d92f4bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93f19e9-586c-40ce-8957-546f1ff10a67', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fcab22-42bd-4d92-87c0-d4a765831649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:58:58 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Volume volume-e93f19e9-586c-40ce-8957-546f1ff10a67 (e93f19e9-586c-40ce-8957-546f1ff10a67): created successfully Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fcab22-42bd-4d92-87c0-d4a765831649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (8471a408-5a94-4db1-a795-518b3476d55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:58:58 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-112eca1a-4388-4c16-abde-1a8c9be2a23e tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:58:58 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404" returned: 0 in 0.421s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2074f057-01d8-49ac-ba84-82e30f67ef38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Acquiring lock "cinder-8fe2b05d-18cd-421b-812f-4a2428a15957-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3191c31-b818-43ee-a8fa-7e29a20c2a97]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Lock "cinder-8fe2b05d-18cd-421b-812f-4a2428a15957-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Acquiring lock "cinder-quobyte-8fe2b05d-18cd-421b-812f-4a2428a15957" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Lock "cinder-quobyte-8fe2b05d-18cd-421b-812f-4a2428a15957" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e21bd8-af74-480f-8815-d9b6e33ee076]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:58 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 Sep 09 03:58:58 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:58 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 Sep 09 03:58:58 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:58 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38" returned: 0 in 0.380s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:58 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 Sep 09 03:58:58 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:58 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957" returned: 0 in 0.363s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:58 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:58 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957 Sep 09 03:58:58 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:59 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404" returned: 0 in 0.320s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:59 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404 Sep 09 03:58:59 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:59 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8fe2b05d-18cd-421b-812f-4a2428a15957" returned: 0 in 0.273s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Lock "cinder-quobyte-8fe2b05d-18cd-421b-812f-4a2428a15957" released by "delete_volume" :: held 0.681s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Created reservations ['0b7dcfb0-0b95-451f-b1f9-727226244a77', '8741e013-777c-433d-8c23-fb9ffa907c13', '1361d632-e233-4108-99e2-7a3340a8f3ce', '8ffc1f26-25cc-46e6-87aa-fcd93245d6e0'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:59 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:58:59 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:59 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38.22700452-8de1-4a6e-9738-6f1e330a8404" returned: 0 in 0.279s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-22700452-8de1-4a6e-9738-6f1e330a8404" released by "_delete_snapshot" :: held 1.513s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-2074f057-01d8-49ac-ba84-82e30f67ef38" released by "delete_snapshot" :: held 1.542s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot 96b4eda0-8fb1-4c5c-b4ae-781aa19e649f of volume e93f19e9-586c-40ce-8957-546f1ff10a67 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Created reservations ['4e245c10-6d4d-40cf-8460-ac34ca562515', 'dc75eed3-c088-4b33-9020-af56b5df85bf', 'de0840c2-545d-43d4-b182-af7ca0e5d38d', 'e5f61a78-1724-4a8f-a7f3-15dff43208e9'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3642300-d1c0-4237-aec1-afda9b6ec738]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:59 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.306s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:58:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Deleted volume successfully. Sep 09 03:58:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Delete snapshot completed successfully. Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-0449752e-8e15-410f-8449-4c84ab4d932b tempest-ProjectReaderTests-1142181577 None] Lock "cinder-22700452-8de1-4a6e-9738-6f1e330a8404-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-31a8e1bd-6c97-487c-a880-e405a3cd024f tempest-ProjectReaderTests-1839840107 None] Lock "cinder-8fe2b05d-18cd-421b-812f-4a2428a15957-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:58:59 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 Sep 09 03:58:59 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:59 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67" returned: 0 in 0.444s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-2074f057-01d8-49ac-ba84-82e30f67ef38-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:58:59 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f 1G Sep 09 03:58:59 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:58:59 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Lock "cinder-2074f057-01d8-49ac-ba84-82e30f67ef38-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-2074f057-01d8-49ac-ba84-82e30f67ef38" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-2074f057-01d8-49ac-ba84-82e30f67ef38" acquired by "delete_volume" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9dd341-6670-4c61-9db6-30701bdcf3ae]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:00 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 Sep 09 03:59:00 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:00 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f 1G" returned: 0 in 0.470s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f19e9-586c-40ce-8957-546f1ff10a67 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:00 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f19e9-586c-40ce-8957-546f1ff10a67 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f Sep 09 03:59:00 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:00 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38" returned: 0 in 0.389s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:00 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38 Sep 09 03:59:00 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:00 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93f19e9-586c-40ce-8957-546f1ff10a67 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f" returned: 0 in 0.320s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:00 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f is being set with open permissions: ugo+rw Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:00 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f Sep 09 03:59:00 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:00 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-2074f057-01d8-49ac-ba84-82e30f67ef38" returned: 0 in 0.273s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-2074f057-01d8-49ac-ba84-82e30f67ef38" released by "delete_volume" :: held 0.753s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Created reservations ['3cb09676-27d4-4405-a6a7-a595be876d3a', 'ef2cc474-e792-4765-835f-83892eb487fa', '1b513097-01a6-4549-bd72-8aeb0e1b9c07', '23c671d7-d094-4129-aee0-07e0fb831fb6'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:00 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:00 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:00 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:00 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f" returned: 0 in 0.290s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:01 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.info Sep 09 03:59:01 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:01 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.329s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:01 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Deleted volume successfully. Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d873c3e2-c03a-4d74-af68-5477184f4a9c tempest-ProjectReaderTests-1142181577 None] Lock "cinder-2074f057-01d8-49ac-ba84-82e30f67ef38-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:01 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.info" returned: 0 in 0.315s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:01 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.info is being set with open permissions: ugo+rw Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:01 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.info Sep 09 03:59:01 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:01 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.info" returned: 0 in 0.291s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:01 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-891f0746-d471-4143-a1f4-e896d79c3f46 tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (a5e76fc6-cd1d-4d5e-94f6-7b97c2660b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bf5248-fb39-4c00-8e0c-92ef3bbafc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bf5248-fb39-4c00-8e0c-92ef3bbafc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512726748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460d6e97-b29a-4a3b-b8a6-bf8657d3d994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:02Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe10e07-7a8d-4b78-84fc-5ebb55c8b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe10e07-7a8d-4b78-84fc-5ebb55c8b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f798987a-290f-4f77-a3ad-527e58b4e0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f798987a-290f-4f77-a3ad-527e58b4e0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '460d6e97-b29a-4a3b-b8a6-bf8657d3d994', 'volume_name': 'volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd7478a-ddc6-4c69-beb1-cee484ba77c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd7478a-ddc6-4c69-beb1-cee484ba77c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd4eb82-7155-427c-8232-28066aa98f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:01 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Volume 460d6e97-b29a-4a3b-b8a6-bf8657d3d994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994', 'volume_size': 1} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512726748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460d6e97-b29a-4a3b-b8a6-bf8657d3d994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:02Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Creating volume 460d6e97-b29a-4a3b-b8a6-bf8657d3d994 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:59:01 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:59:01 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:01 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 1073741824 Sep 09 03:59:01 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:02 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 1073741824" returned: 0 in 0.407s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:02 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 Sep 09 03:59:02 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:02 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd4eb82-7155-427c-8232-28066aa98f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdd2e1c-09c4-401f-93c1-f00f6b376727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:02 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Volume volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 (460d6e97-b29a-4a3b-b8a6-bf8657d3d994): created successfully Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdd2e1c-09c4-401f-93c1-f00f6b376727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (a5e76fc6-cd1d-4d5e-94f6-7b97c2660b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:02 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-f950039d-0c05-496d-aaeb-b94817d74a95 tempest-ProjectReaderTests-1142181577 None] Created volume successfully. Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-96b4eda0-8fb1-4c5c-b4ae-781aa19e649f-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-96b4eda0-8fb1-4c5c-b4ae-781aa19e649f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-e93f19e9-586c-40ce-8957-546f1ff10a67" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e93f19e9-586c-40ce-8957-546f1ff10a67" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-96b4eda0-8fb1-4c5c-b4ae-781aa19e649f" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-96b4eda0-8fb1-4c5c-b4ae-781aa19e649f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot 96b4eda0-8fb1-4c5c-b4ae-781aa19e649f of volume e93f19e9-586c-40ce-8957-546f1ff10a67 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[09763af9-5a5f-4a69-b167-8c56b957bf34]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:02 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f Sep 09 03:59:02 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Creating offline snapshot 4f718ab0-5b2e-48d3-8056-9c1787692444 of volume 460d6e97-b29a-4a3b-b8a6-bf8657d3d994 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c663fd83-e497-4dfc-b285-315ff6d17576]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:02 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:03 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 Sep 09 03:59:03 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:03 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f" returned: 0 in 0.397s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93f19e9-586c-40ce-8957-546f1ff10a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dba1d7b-786c-4f74-8ee7-459cff365aaf]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:03 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 Sep 09 03:59:03 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:03 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" returned: 0 in 0.384s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:03 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 1G Sep 09 03:59:03 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:03 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67" returned: 0 in 0.362s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:03 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f Sep 09 03:59:03 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:03 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 1G" returned: 0 in 0.387s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:03 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 Sep 09 03:59:03 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:03 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:03 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f Sep 09 03:59:03 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:03 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444" returned: 0 in 0.286s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:03 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 is being set with open permissions: ugo+rw Sep 09 03:59:03 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:04 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 Sep 09 03:59:04 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:04 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67.96b4eda0-8fb1-4c5c-b4ae-781aa19e649f" returned: 0 in 0.250s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-96b4eda0-8fb1-4c5c-b4ae-781aa19e649f" released by "_delete_snapshot" :: held 1.425s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e93f19e9-586c-40ce-8957-546f1ff10a67" released by "delete_snapshot" :: held 1.447s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Created reservations ['49c1d553-a94b-4aa7-9951-fa72aaa53f1a', 'ffa54c45-5a7a-489a-bfe8-1679e5417de7', 'a4535e53-0fff-405a-9f1d-39e7b99f36d6', 'a851c77a-acd4-499d-a5e9-11e36e7afd61'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-ab992b0e-b285-4565-bc12-e15cf99c5867 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-96b4eda0-8fb1-4c5c-b4ae-781aa19e649f-delete_snapshot" released by "delete_snapshot" :: held 1.574s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:04 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444" returned: 0 in 0.243s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:04 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.info Sep 09 03:59:04 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:04 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.info" returned: 0 in 0.240s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:04 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.info is being set with open permissions: ugo+rw Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:04 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.info Sep 09 03:59:04 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:04 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.info" returned: 0 in 0.239s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-e93f19e9-586c-40ce-8957-546f1ff10a67-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-e93f19e9-586c-40ce-8957-546f1ff10a67-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:04 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-df29b57e-d195-42e5-bff3-aad7f1287534 tempest-ProjectReaderTests-1142181577 None] Create snapshot completed successfully Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-e93f19e9-586c-40ce-8957-546f1ff10a67" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e93f19e9-586c-40ce-8957-546f1ff10a67" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edaae5c-ea9f-4b83-b067-7da6760235d2]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:05 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 Sep 09 03:59:05 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-4f718ab0-5b2e-48d3-8056-9c1787692444-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-4f718ab0-5b2e-48d3-8056-9c1787692444-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-4f718ab0-5b2e-48d3-8056-9c1787692444" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-4f718ab0-5b2e-48d3-8056-9c1787692444" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Deleting offline snapshot 4f718ab0-5b2e-48d3-8056-9c1787692444 of volume 460d6e97-b29a-4a3b-b8a6-bf8657d3d994 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] snapshot_file for this snap is: volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[64440168-cc48-4310-b03a-51530c8d4ec9]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:05 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 Sep 09 03:59:05 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:05 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67" returned: 0 in 0.379s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:05 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67 Sep 09 03:59:05 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:05 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444" returned: 0 in 0.365s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c012b8e2-b3cf-4193-931c-61832ff9ebf3]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:05 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e93f19e9-586c-40ce-8957-546f1ff10a67" returned: 0 in 0.245s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e93f19e9-586c-40ce-8957-546f1ff10a67" released by "delete_volume" :: held 0.680s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Created reservations ['1cfdf952-4900-439c-a242-2175eb1f8e88', 'bead139f-e32c-428c-8d09-277b09c57c39', 'd6ce90e5-f952-41c0-9fbf-91d106a926c3', '60e50fad-53f4-41bb-a4a5-9ca84dc44f36'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:05 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 Sep 09 03:59:05 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:05 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:05 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:05 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" returned: 0 in 0.375s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:05 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 Sep 09 03:59:05 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:05 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.261s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:05 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:59:05 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8c73ac13-6a2c-4fd5-899d-a7d47855d93c tempest-ProjectMemberTests-1166415715 None] Lock "cinder-e93f19e9-586c-40ce-8957-546f1ff10a67-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:06 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444" returned: 0 in 0.376s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:06 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444 Sep 09 03:59:06 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (d010993d-3d4d-46f1-91d0-4f47237bc9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8c7323-9021-485d-94bd-639030b1adcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8c7323-9021-485d-94bd-639030b1adcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855231627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:06Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22507f02-f308-4c8d-81fb-c89473457ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22507f02-f308-4c8d-81fb-c89473457ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d403f313-2ba4-475b-bbdf-abe393594aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d403f313-2ba4-475b-bbdf-abe393594aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c', 'volume_name': 'volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5056ff72-bd46-4de6-9c52-26020851e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5056ff72-bd46-4de6-9c52-26020851e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0ad73c-3612-4372-9d60-cff862424b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:06 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Volume 00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c', 'volume_size': 1} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855231627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:06Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Creating volume 00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:59:06 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:06 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994.4f718ab0-5b2e-48d3-8056-9c1787692444" returned: 0 in 0.246s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:06 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c 1073741824 Sep 09 03:59:06 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-4f718ab0-5b2e-48d3-8056-9c1787692444" released by "_delete_snapshot" :: held 1.451s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" released by "delete_snapshot" :: held 1.475s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Created reservations ['5337da8c-a30b-44cf-9ee2-4d386602b864', '2a715838-b46b-41e2-a5e3-5e71b90c0ef0', '98da5bed-6b87-4e2d-9392-e84ff0126388', 'a2eb5903-dc86-4950-a390-896a50b0f38b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:06 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Delete snapshot completed successfully. Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-c22a824c-a201-4fe9-969c-254dd23cd3b6 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-4f718ab0-5b2e-48d3-8056-9c1787692444-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:06 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c 1073741824" returned: 0 in 0.429s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:06 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c Sep 09 03:59:06 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:07 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-460d6e97-b29a-4a3b-b8a6-bf8657d3d994-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0ad73c-3612-4372-9d60-cff862424b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8325159e-8b4e-40fc-931d-05c82627a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-460d6e97-b29a-4a3b-b8a6-bf8657d3d994-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:07 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Volume volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c (00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c): created successfully Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8325159e-8b4e-40fc-931d-05c82627a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (d010993d-3d4d-46f1-91d0-4f47237bc9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-ee0946d0-2caa-4991-86e9-9f9feb10233b tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9d9f7c-4636-4418-af81-c83c4efaa5f8]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:07 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 Sep 09 03:59:07 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot bf0c583b-b182-4942-af7c-69417efab716 of volume 00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75fc8cd-1a3f-4743-8ba0-82cb9d5d8703]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:07 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" returned: 0 in 0.386s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:07 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c Sep 09 03:59:07 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:07 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994 Sep 09 03:59:07 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:07 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" returned: 0 in 0.245s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:07 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-460d6e97-b29a-4a3b-b8a6-bf8657d3d994" released by "delete_volume" :: held 0.689s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:08 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" returned: 0 in 0.379s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:08 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 1G Sep 09 03:59:08 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Created reservations ['065616e5-b8b2-4f85-88b7-daac0087b2f6', '95526968-e3f5-4c47-b204-064b7568fe6a', '9bf252e4-5bdc-447d-87c0-d73d809b9b3e', '5a1f2b0a-9691-43bb-b46f-36db333336f3'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:08 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:08 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:08 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.252s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:08 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Deleted volume successfully. Sep 09 03:59:08 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 1G" returned: 0 in 0.400s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-d7643e9b-1747-4147-a950-fb7ac499ca00 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-460d6e97-b29a-4a3b-b8a6-bf8657d3d994-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:08 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 Sep 09 03:59:08 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:08 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716" returned: 0 in 0.300s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:08 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 is being set with open permissions: ugo+rw Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:08 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 Sep 09 03:59:08 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (1173496f-235d-4692-8bbf-86266d148445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c0b74d-b6cb-441d-9b32-603695bcdfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c0b74d-b6cb-441d-9b32-603695bcdfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-804674684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6df1639-08ac-439d-8ea5-3059056f3fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:09Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bdc179-67cc-4511-ba69-a8dda81f590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bdc179-67cc-4511-ba69-a8dda81f590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f78866-59d7-4877-91bf-b7464923864e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f78866-59d7-4877-91bf-b7464923864e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6df1639-08ac-439d-8ea5-3059056f3fa7', 'volume_name': 'volume-f6df1639-08ac-439d-8ea5-3059056f3fa7', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484f6310-fae2-47d5-bc4f-d7a1daa92232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484f6310-fae2-47d5-bc4f-d7a1daa92232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89a7189-30fd-4a56-8de2-0fef3a721823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:08 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Volume f6df1639-08ac-439d-8ea5-3059056f3fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6df1639-08ac-439d-8ea5-3059056f3fa7', 'volume_size': 1} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:08 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716" returned: 0 in 0.241s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:08 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.info Sep 09 03:59:08 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:09 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.info" returned: 0 in 0.235s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:09 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.info is being set with open permissions: ugo+rw Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:09 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.info Sep 09 03:59:09 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:09 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.info" returned: 0 in 0.237s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-804674684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6df1639-08ac-439d-8ea5-3059056f3fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88ebac98ef44ffb8a8bf4a237c36d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:09Z,use_quota=True,user_id='b87febd81f4a45948dfd4c928a841da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Creating volume f6df1639-08ac-439d-8ea5-3059056f3fa7 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:59:09 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:09 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 1073741824 Sep 09 03:59:09 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:09 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-791d5fb7-07d5-49d4-a773-7f3b16f89f5d tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-bf0c583b-b182-4942-af7c-69417efab716-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-bf0c583b-b182-4942-af7c-69417efab716-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-bf0c583b-b182-4942-af7c-69417efab716" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-bf0c583b-b182-4942-af7c-69417efab716" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot bf0c583b-b182-4942-af7c-69417efab716 of volume 00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d870753f-321e-428d-bc96-4019ad6ab62b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:09 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 Sep 09 03:59:09 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:09 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 1073741824" returned: 0 in 0.465s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:09 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 Sep 09 03:59:10 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:10 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716" returned: 0 in 0.358s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9480c854-329a-491e-8858-79adb68722df]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:10 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7" returned: 0 in 0.252s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89a7189-30fd-4a56-8de2-0fef3a721823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6df1639-08ac-439d-8ea5-3059056f3fa7', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478598b0-7956-4cec-905d-5268129700dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:10 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Volume volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 (f6df1639-08ac-439d-8ea5-3059056f3fa7): created successfully Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478598b0-7956-4cec-905d-5268129700dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Flow 'volume_create_manager' (1173496f-235d-4692-8bbf-86266d148445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:10 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-449511cb-f080-483b-b46c-4d8f20cfd162 tempest-ProjectReaderTests-1142181577 None] Created volume successfully. Sep 09 03:59:10 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c Sep 09 03:59:10 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:10 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" returned: 0 in 0.345s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:10 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 Sep 09 03:59:10 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:10 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:10 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:10 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716 Sep 09 03:59:10 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Creating offline snapshot 64bf0333-b244-40e0-9922-c6b35de1f808 of volume f6df1639-08ac-439d-8ea5-3059056f3fa7 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a79fdee-3a45-4cda-a3f4-55f788009f9b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:11 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c.bf0c583b-b182-4942-af7c-69417efab716" returned: 0 in 0.248s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-bf0c583b-b182-4942-af7c-69417efab716" released by "_delete_snapshot" :: held 1.382s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" released by "delete_snapshot" :: held 1.405s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:11 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 Sep 09 03:59:11 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Created reservations ['bf12b758-339c-4744-a478-70f341f0b83b', '4b222ba1-177d-4313-b441-724bee646145', 'fc5198eb-5f12-452f-a68c-189149dc96ee', '1e10631b-ed24-423f-9a7b-2e34e6331cec'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:11 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a0e64b9d-80df-47d5-9647-0f12e2e6c104 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-bf0c583b-b182-4942-af7c-69417efab716-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:11 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7" returned: 0 in 0.359s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:11 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 1G Sep 09 03:59:11 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:11 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 1G" returned: 0 in 0.373s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:11 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 Sep 09 03:59:11 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" acquired by "delete_volume" :: waited 0.024s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7de9623-5dcc-418a-a3e2-49fffcc068fc]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:11 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:12 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c Sep 09 03:59:12 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:12 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808" returned: 0 in 0.294s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:12 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 is being set with open permissions: ugo+rw Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:12 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 Sep 09 03:59:12 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:12 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" returned: 0 in 0.354s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:12 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c Sep 09 03:59:12 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:12 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808" returned: 0 in 0.249s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:12 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.info Sep 09 03:59:12 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:12 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" returned: 0 in 0.241s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c" released by "delete_volume" :: held 0.650s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:12 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.info" returned: 0 in 0.249s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:12 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.info is being set with open permissions: ugo+rw Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Created reservations ['c1beffd7-f1a6-4aa6-adc0-693687735c8b', 'a11e11af-2d76-42aa-844f-a6021f7aed7c', '9d9d62d0-5caf-46e1-9993-ba583395758e', 'f879edfa-3e51-4acd-acc0-207fe6eaa36f'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:12 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.info Sep 09 03:59:12 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:12 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:12 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:12 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.info" returned: 0 in 0.248s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8238b706-30bf-40e3-835e-8832feb91a65 tempest-ProjectReaderTests-1142181577 None] Create snapshot completed successfully Sep 09 03:59:12 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.243s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:12 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:12 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-099dc989-cdda-4e36-976e-635355829b39 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-00f4bb4f-2a66-4b4d-9d3c-a0ca7fda779c-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-64bf0333-b244-40e0-9922-c6b35de1f808-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-64bf0333-b244-40e0-9922-c6b35de1f808-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-f6df1639-08ac-439d-8ea5-3059056f3fa7" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-f6df1639-08ac-439d-8ea5-3059056f3fa7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-64bf0333-b244-40e0-9922-c6b35de1f808" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-64bf0333-b244-40e0-9922-c6b35de1f808" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Deleting offline snapshot 64bf0333-b244-40e0-9922-c6b35de1f808 of volume f6df1639-08ac-439d-8ea5-3059056f3fa7 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] snapshot_file for this snap is: volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a44e9a8-cb99-466a-889b-609fceadba58]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:13 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 Sep 09 03:59:13 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (7ce4a210-c5df-424d-8d6b-dd3bd290b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb389d7-4736-4ce3-bc9a-62d26873f479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb389d7-4736-4ce3-bc9a-62d26873f479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976482304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fe0eee-5c0b-437c-860c-f7e244dd4e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:13Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615ff049-c8df-4f9c-bddd-2c0b2cbd3512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615ff049-c8df-4f9c-bddd-2c0b2cbd3512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837ca213-8d60-4a57-b265-d68943ad2a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837ca213-8d60-4a57-b265-d68943ad2a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fe0eee-5c0b-437c-860c-f7e244dd4e65', 'volume_name': 'volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baa01cc-66a0-49ca-aeb5-32b3c7f1f44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baa01cc-66a0-49ca-aeb5-32b3c7f1f44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f9cd78-599b-41e4-93bb-5bcbeb7e50ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:13 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Volume 95fe0eee-5c0b-437c-860c-f7e244dd4e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65', 'volume_size': 1} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976482304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fe0eee-5c0b-437c-860c-f7e244dd4e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:13Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Creating volume 95fe0eee-5c0b-437c-860c-f7e244dd4e65 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:59:13 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:13 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 1073741824 Sep 09 03:59:13 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:13 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808" returned: 0 in 0.384s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6df1639-08ac-439d-8ea5-3059056f3fa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a973e9d3-05cc-4fa5-87d5-a066262e5ea0]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:13 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 Sep 09 03:59:13 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:14 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 1073741824" returned: 0 in 0.425s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:14 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7" returned: 0 in 0.386s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:14 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 Sep 09 03:59:14 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:14 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 Sep 09 03:59:14 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:14 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65" returned: 0 in 0.242s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f9cd78-599b-41e4-93bb-5bcbeb7e50ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf418e2b-d059-48fa-9255-9dada97864ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:14 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Volume volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 (95fe0eee-5c0b-437c-860c-f7e244dd4e65): created successfully Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf418e2b-d059-48fa-9255-9dada97864ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (7ce4a210-c5df-424d-8d6b-dd3bd290b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a5b28d13-2ba3-4f90-a9c7-9249b04ddb91 tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:59:14 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808" returned: 0 in 0.348s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:14 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808 Sep 09 03:59:14 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:14 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7.64bf0333-b244-40e0-9922-c6b35de1f808" returned: 0 in 0.238s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-64bf0333-b244-40e0-9922-c6b35de1f808" released by "_delete_snapshot" :: held 1.453s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-f6df1639-08ac-439d-8ea5-3059056f3fa7" released by "delete_snapshot" :: held 1.479s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Created reservations ['77727f1a-0f1c-4d98-ac35-b9d6f728b0c8', 'ed22e331-4da2-4b31-b702-78029e7a6d70', '68c84776-8aec-4c8c-a501-29efac0ce98d', '6325c621-cb63-4542-a655-dd1d3fb00eb0'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:14 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Delete snapshot completed successfully. Sep 09 03:59:14 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-288880d3-0b8a-4144-85bc-d72a1a7f9956 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-64bf0333-b244-40e0-9922-c6b35de1f808-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-f6df1639-08ac-439d-8ea5-3059056f3fa7-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-f6df1639-08ac-439d-8ea5-3059056f3fa7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "cinder-quobyte-f6df1639-08ac-439d-8ea5-3059056f3fa7" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-f6df1639-08ac-439d-8ea5-3059056f3fa7" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e88d651-717f-41dd-80f8-d40ef088bb92]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:15 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 Sep 09 03:59:15 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot 0032f16d-53b3-43db-8349-98d1603d750a of volume 95fe0eee-5c0b-437c-860c-f7e244dd4e65 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:59:15 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7" returned: 0 in 0.382s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ca14ba-bc1d-4d03-b06a-0f16aedb6f5c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:15 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7 Sep 09 03:59:15 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:15 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 Sep 09 03:59:15 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:16 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-f6df1639-08ac-439d-8ea5-3059056f3fa7" returned: 0 in 0.237s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-quobyte-f6df1639-08ac-439d-8ea5-3059056f3fa7" released by "delete_volume" :: held 0.677s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Created reservations ['ef793546-1391-4d31-92bb-e57aa6d60aef', '0daf0061-2a85-4d2d-bd2a-84a34aabade8', 'c20fc150-30e3-460b-b424-f389df3c3bc6', 'c1bbdec8-a0da-4f9b-a1a3-29478c60ac0b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:16 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65" returned: 0 in 0.368s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:16 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:16 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:16 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a 1G Sep 09 03:59:16 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:16 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.239s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Deleted volume successfully. Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ef364c6-d9c9-4e33-9020-cdd09735baa3 tempest-ProjectReaderTests-1142181577 None] Lock "cinder-f6df1639-08ac-439d-8ea5-3059056f3fa7-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:16 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a 1G" returned: 0 in 0.422s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:16 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a Sep 09 03:59:16 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:16 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a" returned: 0 in 0.288s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:16 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a is being set with open permissions: ugo+rw Sep 09 03:59:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:16 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a Sep 09 03:59:16 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:17 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a" returned: 0 in 0.246s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:17 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.info Sep 09 03:59:17 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:17 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.info" returned: 0 in 0.259s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:17 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.info is being set with open permissions: ugo+rw Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:17 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.info Sep 09 03:59:17 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:17 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.info" returned: 0 in 0.258s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:17 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-2a0bb228-440a-4400-886a-7a761548e38b tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-0032f16d-53b3-43db-8349-98d1603d750a-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-0032f16d-53b3-43db-8349-98d1603d750a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-95fe0eee-5c0b-437c-860c-f7e244dd4e65" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-95fe0eee-5c0b-437c-860c-f7e244dd4e65" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-0032f16d-53b3-43db-8349-98d1603d750a" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-0032f16d-53b3-43db-8349-98d1603d750a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot 0032f16d-53b3-43db-8349-98d1603d750a of volume 95fe0eee-5c0b-437c-860c-f7e244dd4e65 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e1f661-2436-41cb-a630-c02a1a554984]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:18 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a Sep 09 03:59:18 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:18 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a" returned: 0 in 0.357s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0fd86f-ae5f-4cff-a4be-146ba5e3e9e9]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:18 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 Sep 09 03:59:18 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:18 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65" returned: 0 in 0.363s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:18 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a Sep 09 03:59:18 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:19 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a" returned: 0 in 0.372s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:19 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a Sep 09 03:59:19 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:19 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:19 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65.0032f16d-53b3-43db-8349-98d1603d750a" returned: 0 in 0.245s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-0032f16d-53b3-43db-8349-98d1603d750a" released by "_delete_snapshot" :: held 1.430s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-95fe0eee-5c0b-437c-860c-f7e244dd4e65" released by "delete_snapshot" :: held 1.453s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:19 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Created reservations ['9e44077f-dd83-425e-abbd-e95ef8ca67ae', '6eb5b97c-e8fa-4584-999b-b12a3822b1a7', 'a9f84947-037b-48ad-b8fa-7dc4faaa4949', '3f67432b-169d-4b9d-b20d-4541d7f6c927'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:19 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:59:19 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-da69cbf5-2513-4101-ba75-d02adfe875d7 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-0032f16d-53b3-43db-8349-98d1603d750a-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-95fe0eee-5c0b-437c-860c-f7e244dd4e65-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-95fe0eee-5c0b-437c-860c-f7e244dd4e65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-95fe0eee-5c0b-437c-860c-f7e244dd4e65" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-95fe0eee-5c0b-437c-860c-f7e244dd4e65" acquired by "delete_volume" :: waited 0.025s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82bd639-62ad-414f-9dbb-dc5123bf169a]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:20 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 Sep 09 03:59:20 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:20 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65" returned: 0 in 0.344s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:20 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65 Sep 09 03:59:20 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:20 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-95fe0eee-5c0b-437c-860c-f7e244dd4e65" returned: 0 in 0.229s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-95fe0eee-5c0b-437c-860c-f7e244dd4e65" released by "delete_volume" :: held 0.634s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Created reservations ['52a87432-3dc1-460b-b378-9cf8cf9bd772', 'b3d9864d-b867-4a18-b845-45b6af63ad64', 'c07e7418-f1e9-4c9d-9d8b-955d99dd5ae8', '51eb458e-b67f-40d5-ba60-b75d7a810a6b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:20 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:21 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:21 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:21 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.237s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:21 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-3ca77635-3777-4659-94e6-0cddd3fbda63 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-95fe0eee-5c0b-437c-860c-f7e244dd4e65-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (035caa74-a057-4e82-8335-1b8d4a112763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef7c88a-ae9b-4d80-b3b0-aee27bbd9daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef7c88a-ae9b-4d80-b3b0-aee27bbd9daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448347871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c56851-8aab-4201-b4e9-8698a35fbe7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:22Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c05579-7f06-4ed1-9c6c-1b688090eeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c05579-7f06-4ed1-9c6c-1b688090eeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43638250-7a1d-4ac7-bc54-6d5ddd384b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43638250-7a1d-4ac7-bc54-6d5ddd384b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c56851-8aab-4201-b4e9-8698a35fbe7d', 'volume_name': 'volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4beaed69-9b8e-4b39-9fe8-54f05b0fc9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4beaed69-9b8e-4b39-9fe8-54f05b0fc9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9365c18b-a192-43b1-8735-c70c24afc5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:21 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Volume e3c56851-8aab-4201-b4e9-8698a35fbe7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d', 'volume_size': 1} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448347871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c56851-8aab-4201-b4e9-8698a35fbe7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545fa2156ebc46c2aca7a4b4b3c3c9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:22Z,use_quota=True,user_id='b510adce1b2446a199730e9b143576d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Creating volume e3c56851-8aab-4201-b4e9-8698a35fbe7d {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:59:21 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:59:21 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:21 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d 1073741824 Sep 09 03:59:21 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:22 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d 1073741824" returned: 0 in 0.422s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:22 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d Sep 09 03:59:22 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:22 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d" returned: 0 in 0.241s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9365c18b-a192-43b1-8735-c70c24afc5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5bca15-5177-4ab7-a575-f22740a65c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:22 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Volume volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d (e3c56851-8aab-4201-b4e9-8698a35fbe7d): created successfully Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5bca15-5177-4ab7-a575-f22740a65c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Flow 'volume_create_manager' (035caa74-a057-4e82-8335-1b8d4a112763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:22 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0c96986a-0c11-4ed4-99f8-9345d6355e64 tempest-ProjectMemberTests-1166415715 None] Created volume successfully. Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:22 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Creating offline snapshot 17960a2b-1480-414b-b8f5-bb190c1a2d1b of volume e3c56851-8aab-4201-b4e9-8698a35fbe7d {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 03:59:23 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[11277913-6323-40b0-bbdc-83f1918e96cf]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:23 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d Sep 09 03:59:23 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:23 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d" returned: 0 in 0.372s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:23 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b 1G Sep 09 03:59:23 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:23 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b 1G" returned: 0 in 0.411s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:23 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:23 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b Sep 09 03:59:23 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:24 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b" returned: 0 in 0.311s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:24 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b is being set with open permissions: ugo+rw Sep 09 03:59:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:24 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b Sep 09 03:59:24 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:24 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b" returned: 0 in 0.229s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:24 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.info Sep 09 03:59:24 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:24 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.info" returned: 0 in 0.234s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:24 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.info is being set with open permissions: ugo+rw Sep 09 03:59:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:24 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.info Sep 09 03:59:24 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:24 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.info" returned: 0 in 0.227s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:24 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:24 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-cd8de875-38f1-4bb7-9c1d-c16a724b3cb3 tempest-ProjectMemberTests-1166415715 None] Create snapshot completed successfully Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-17960a2b-1480-414b-b8f5-bb190c1a2d1b-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Lock "cinder-17960a2b-1480-414b-b8f5-bb190c1a2d1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-e3c56851-8aab-4201-b4e9-8698a35fbe7d" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e3c56851-8aab-4201-b4e9-8698a35fbe7d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-17960a2b-1480-414b-b8f5-bb190c1a2d1b" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-17960a2b-1480-414b-b8f5-bb190c1a2d1b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Deleting offline snapshot 17960a2b-1480-414b-b8f5-bb190c1a2d1b of volume e3c56851-8aab-4201-b4e9-8698a35fbe7d {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] snapshot_file for this snap is: volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0ae1a7-ab3f-47c9-811e-03a213b502be]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:25 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b Sep 09 03:59:25 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:25 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b" returned: 0 in 0.370s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d2fce-c9eb-40a2-abfa-6d64c2ed0044]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:25 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:25 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d Sep 09 03:59:25 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:26 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d" returned: 0 in 0.351s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:26 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b Sep 09 03:59:26 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:26 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:26 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b Sep 09 03:59:26 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:26 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d.17960a2b-1480-414b-b8f5-bb190c1a2d1b" returned: 0 in 0.271s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-17960a2b-1480-414b-b8f5-bb190c1a2d1b" released by "_delete_snapshot" :: held 1.428s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e3c56851-8aab-4201-b4e9-8698a35fbe7d" released by "delete_snapshot" :: held 1.451s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Created reservations ['709dc470-c0fd-4f52-b659-4ad308215fee', '1d13ce21-9dc5-43da-94dd-f4589ea75356', '97170cfb-6570-4c88-9fda-0d46dbe10638', '51e37408-55e1-42bd-aa0f-02bcad11820b'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:26 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Delete snapshot completed successfully. Sep 09 03:59:26 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a9d7a1a9-0991-453a-b833-f467bacfc9cb tempest-ProjectMemberTests-1166415715 None] Lock "cinder-17960a2b-1480-414b-b8f5-bb190c1a2d1b-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-e3c56851-8aab-4201-b4e9-8698a35fbe7d-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-e3c56851-8aab-4201-b4e9-8698a35fbe7d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "cinder-quobyte-e3c56851-8aab-4201-b4e9-8698a35fbe7d" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:27 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e3c56851-8aab-4201-b4e9-8698a35fbe7d" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:27 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30833d6-297d-4027-957f-2613f3dbf39f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:27 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d Sep 09 03:59:27 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:27 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d" returned: 0 in 0.370s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:27 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:27 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d Sep 09 03:59:27 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:28 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-e3c56851-8aab-4201-b4e9-8698a35fbe7d" returned: 0 in 0.259s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-quobyte-e3c56851-8aab-4201-b4e9-8698a35fbe7d" released by "delete_volume" :: held 0.693s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Created reservations ['ac59faa2-0a7b-46cd-9582-587a58ca5b9d', '8c97bd97-3448-403c-a299-4972a2642c4a', '319f2fc6-0cba-4d27-b454-24482a22f1d2', '13d82148-bdee-4e34-9c45-56b11b2aadb1'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:28 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:28 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:28 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.253s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:28 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Deleted volume successfully. Sep 09 03:59:28 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-b46fd217-c573-4844-9b69-3c2626d1f279 tempest-ProjectMemberTests-1166415715 None] Lock "cinder-e3c56851-8aab-4201-b4e9-8698a35fbe7d-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Flow 'volume_create_manager' (fdfdf8bd-c82e-4e20-804b-393b2a18b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6134cf4-6bcc-49a9-a609-c5a9f3ad1459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6134cf4-6bcc-49a9-a609-c5a9f3ad1459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-872398493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db74039-4dfb-41cb-96b2-dcfc1bd8f45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a0eb50183440c3ba8dfd5e52fdbff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:29Z,use_quota=True,user_id='9e4503ccdda341a284a08d60de030701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09d1b3e-389f-4535-ab28-6fb96dd6ca8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09d1b3e-389f-4535-ab28-6fb96dd6ca8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4691348-dd33-4ed8-a2c2-3c50276f65e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4691348-dd33-4ed8-a2c2-3c50276f65e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db74039-4dfb-41cb-96b2-dcfc1bd8f45f', 'volume_name': 'volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82776c3-0c6a-4655-b010-9d27787781c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82776c3-0c6a-4655-b010-9d27787781c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a701dc-ae87-4b25-988c-07809c2d8a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:29 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Volume 8db74039-4dfb-41cb-96b2-dcfc1bd8f45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f', 'volume_size': 1} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-872398493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db74039-4dfb-41cb-96b2-dcfc1bd8f45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a0eb50183440c3ba8dfd5e52fdbff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:29Z,use_quota=True,user_id='9e4503ccdda341a284a08d60de030701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Creating volume 8db74039-4dfb-41cb-96b2-dcfc1bd8f45f {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:59:29 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:29 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f 1073741824 Sep 09 03:59:29 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:29 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f 1073741824" returned: 0 in 0.453s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:29 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f Sep 09 03:59:29 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:29 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f" returned: 0 in 0.245s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a701dc-ae87-4b25-988c-07809c2d8a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378f5761-e91f-470f-9470-40b6eec61926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:29 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Volume volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f (8db74039-4dfb-41cb-96b2-dcfc1bd8f45f): created successfully Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378f5761-e91f-470f-9470-40b6eec61926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:29 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Flow 'volume_create_manager' (fdfdf8bd-c82e-4e20-804b-393b2a18b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:29 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-67ef4ab1-63f2-43fe-9726-84f232a9f227 tempest-ProjectReaderTests-1298944885 None] Created volume successfully. Sep 09 03:59:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Acquiring lock "cinder-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Lock "cinder-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Acquiring lock "cinder-quobyte-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:30 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Lock "cinder-quobyte-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f" acquired by "delete_volume" :: waited 0.017s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:30 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[929eab45-b750-4c38-a34e-3501cfddc08c]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:30 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f Sep 09 03:59:30 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:30 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f" returned: 0 in 0.356s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:30 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:30 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f Sep 09 03:59:30 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:31 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f" returned: 0 in 0.252s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Lock "cinder-quobyte-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f" released by "delete_volume" :: held 0.649s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Created reservations ['f4767d04-c1c6-4183-9781-3956f811a553', 'b105561c-616f-444a-80c2-72e92f335a8b', '50652103-ae59-459a-856d-90cfe825d7c0', '77c2a1df-115f-4b52-926f-6041cb74fb85'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:31 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:31 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:31 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.244s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:31 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Deleted volume successfully. Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-a36f0793-2ad1-4480-9a1a-55d41be5bd37 tempest-ProjectReaderTests-1298944885 None] Lock "cinder-8db74039-4dfb-41cb-96b2-dcfc1bd8f45f-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=266,cinder:SELECT=215,cinder:DELETE=23,cinder:INSERT=76 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=186,cinder:INSERT=68,cinder:UPDATE=270,cinder:DELETE=22 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Flow 'volume_create_manager' (4d31dc10-1535-4989-a242-a0810397a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:31 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639f439a-d366-4729-ab37-4d6a6044628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639f439a-d366-4729-ab37-4d6a6044628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061844593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f2b562-455e-466f-8198-24ca5355de24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a0eb50183440c3ba8dfd5e52fdbff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:32Z,use_quota=True,user_id='9e4503ccdda341a284a08d60de030701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94dcc21-4792-41c7-8fa7-6e74456b98da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94dcc21-4792-41c7-8fa7-6e74456b98da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615ee819-5922-4e8c-acc8-2ec5f456a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615ee819-5922-4e8c-acc8-2ec5f456a68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f2b562-455e-466f-8198-24ca5355de24', 'volume_name': 'volume-26f2b562-455e-466f-8198-24ca5355de24', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3c1096-5725-4d98-b7fc-0b89b795044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3c1096-5725-4d98-b7fc-0b89b795044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f961702-856c-4672-884a-ae2978e3e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Volume 26f2b562-455e-466f-8198-24ca5355de24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f2b562-455e-466f-8198-24ca5355de24', 'volume_size': 1} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T01:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061844593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f2b562-455e-466f-8198-24ca5355de24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a0eb50183440c3ba8dfd5e52fdbff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T01:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T01:59:32Z,use_quota=True,user_id='9e4503ccdda341a284a08d60de030701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Creating volume 26f2b562-455e-466f-8198-24ca5355de24 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 03:59:32 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:32 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 1073741824 Sep 09 03:59:32 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:32 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 1073741824" returned: 0 in 0.412s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:32 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 Sep 09 03:59:32 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:32 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24" returned: 0 in 0.238s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f961702-856c-4672-884a-ae2978e3e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f2b562-455e-466f-8198-24ca5355de24', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e231de-bde0-447e-8f24-567fa554afda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 03:59:32 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Volume volume-26f2b562-455e-466f-8198-24ca5355de24 (26f2b562-455e-466f-8198-24ca5355de24): created successfully Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e231de-bde0-447e-8f24-567fa554afda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Flow 'volume_create_manager' (4d31dc10-1535-4989-a242-a0810397a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 03:59:32 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-9379fb8d-fbc1-46b1-a035-2bc17beed7c9 tempest-ProjectReaderTests-1298944885 None] Created volume successfully. Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Acquiring lock "cinder-26f2b562-455e-466f-8198-24ca5355de24-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:32 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Lock "cinder-26f2b562-455e-466f-8198-24ca5355de24-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Acquiring lock "cinder-quobyte-26f2b562-455e-466f-8198-24ca5355de24" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Lock "cinder-quobyte-26f2b562-455e-466f-8198-24ca5355de24" acquired by "delete_volume" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e02d1e7-f695-4ca5-86ee-fc50bef40e38]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:33 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 Sep 09 03:59:33 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:33 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24" returned: 0 in 0.355s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:33 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24 Sep 09 03:59:33 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:33 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-26f2b562-455e-466f-8198-24ca5355de24" returned: 0 in 0.255s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Lock "cinder-quobyte-26f2b562-455e-466f-8198-24ca5355de24" released by "delete_volume" :: held 0.649s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Created reservations ['3cfacc6e-3a2a-437c-b2a0-275322d919b8', 'c7f76d7e-3f54-48bc-884b-b9a527ce5d5b', '1dc49b1c-df88-4fa6-b26e-625ae7f43c34', 'dcb671e5-3a9d-4ae3-b0fc-769dca0a0ddf'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:33 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:33 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:33 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:34 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:34 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.278s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:34 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:34 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Deleted volume successfully. Sep 09 03:59:34 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-8d0a2ec3-2cf7-49ae-83c8-3e148cc6b39d tempest-ProjectReaderTests-1298944885 None] Lock "cinder-26f2b562-455e-466f-8198-24ca5355de24-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 03:59:37 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 03:59:37 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 03:59:37 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.249s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 03:59:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 03:59:43 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 03:59:44 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Flow 'volume_create_manager' (b429fefa-ff8a-48ae-b52e-174e10e6ff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a585a2-0b30-4b87-afba-2805028b38ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a585a2-0b30-4b87-afba-2805028b38ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T02:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1341483893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf17b2ee-7c02-4a16-b370-074901460af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a3c544455d485c992506964aaceb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:04Z,use_quota=True,user_id='c9d2b3edeadb455bb1c3dd5d0c839aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d01e49-e862-4fd8-b012-afcfc1e774e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d01e49-e862-4fd8-b012-afcfc1e774e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d674531d-8006-4be3-a85d-6ed4c36477df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d674531d-8006-4be3-a85d-6ed4c36477df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf17b2ee-7c02-4a16-b370-074901460af9', 'volume_name': 'volume-cf17b2ee-7c02-4a16-b370-074901460af9', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6359f552-168c-4b1e-a8b9-a781dc56219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6359f552-168c-4b1e-a8b9-a781dc56219b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb7f6c2-60fd-45c9-b338-734435c5e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:04 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Volume cf17b2ee-7c02-4a16-b370-074901460af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf17b2ee-7c02-4a16-b370-074901460af9', 'volume_size': 1} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T02:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1341483893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf17b2ee-7c02-4a16-b370-074901460af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a3c544455d485c992506964aaceb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:04Z,use_quota=True,user_id='c9d2b3edeadb455bb1c3dd5d0c839aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)}" {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Creating volume cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 04:00:04 devstack cinder-volume[87597]: INFO cinder.volume.drivers.remotefs [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] casted to osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 1073741824 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:04 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 1073741824 Sep 09 04:00:04 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:04 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:04 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 1073741824" returned: 0 in 0.388s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:05 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 Sep 09 04:00:05 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:05 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9" returned: 0 in 0.233s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'} {{(pid=87597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb7f6c2-60fd-45c9-b338-734435c5e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf17b2ee-7c02-4a16-b370-074901460af9', 'volume_size': 1}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a5faa9-5d98-4f9e-ab69-96114470ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:05 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Volume volume-cf17b2ee-7c02-4a16-b370-074901460af9 (cf17b2ee-7c02-4a16-b370-074901460af9): created successfully Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a5faa9-5d98-4f9e-ab69-96114470ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Flow 'volume_create_manager' (b429fefa-ff8a-48ae-b52e-174e10e6ff89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 04:00:05 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-d3916454-0264-477a-9e00-eebdbd0bb18f tempest-SnapshotDependencyTests-1268419799 None] Created volume successfully. Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Creating offline snapshot 200b8034-32b6-4484-901e-c1bf9a48547e of volume cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75dd77f-474f-47d2-8f28-6e4b128d24aa]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 04:00:05 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:05 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 Sep 09 04:00:05 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:06 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9" returned: 0 in 0.339s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e 1G {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:06 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e 1G Sep 09 04:00:06 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:06 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e 1G" returned: 0 in 0.364s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf17b2ee-7c02-4a16-b370-074901460af9 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:06 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf17b2ee-7c02-4a16-b370-074901460af9 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e Sep 09 04:00:06 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:06 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf17b2ee-7c02-4a16-b370-074901460af9 -F qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e" returned: 0 in 0.266s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:06 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e is being set with open permissions: ugo+rw Sep 09 04:00:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:06 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e Sep 09 04:00:06 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:06 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e" returned: 0 in 0.231s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:07 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.info Sep 09 04:00:07 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:07 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.info" returned: 0 in 0.236s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:07 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.info is being set with open permissions: ugo+rw Sep 09 04:00:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.info {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:07 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.info Sep 09 04:00:07 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:07 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.info" returned: 0 in 0.225s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:07 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.736s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:07 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-0df2a136-08be-4ced-87ed-2a57db592a37 tempest-SnapshotDependencyTests-1268419799 None] Create snapshot completed successfully Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.flows.manager.create_volume [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Flow 'volume_create_manager' (932bb0a2-51e7-43be-b5bf-086b6e18c336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64865e42-f333-429c-877f-37766f6a5e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64865e42-f333-429c-877f-37766f6a5e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T02:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ab42dc-9cb5-46d1-a9b4-7435e2155818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a3c544455d485c992506964aaceb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T02:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=200b8034-32b6-4484-901e-c1bf9a48547e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T02:00:08Z,use_quota=True,user_id='c9d2b3edeadb455bb1c3dd5d0c839aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8314b37c-0de4-4fdf-afe5-825aa3849510),volume_type_id=8314b37c-0de4-4fdf-afe5-825aa3849510)' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9359b42-c519-4b42-9b39-56b624fdce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9359b42-c519-4b42-9b39-56b624fdce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277f4c6f-1b08-45b1-a9e8-77df5a4b817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277f4c6f-1b08-45b1-a9e8-77df5a4b817a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76ab42dc-9cb5-46d1-a9b4-7435e2155818', 'volume_name': 'volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818', 'volume_size': 1, 'snapshot_id': '200b8034-32b6-4484-901e-c1bf9a48547e'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85805e47-1cca-49a1-8e51-3d111e23f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85805e47-1cca-49a1-8e51-3d111e23f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0779b1-2efe-45f2-83ae-6dc6a3affbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:08 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Volume 76ab42dc-9cb5-46d1-a9b4-7435e2155818: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818', 'volume_size': 1, 'snapshot_id': '200b8034-32b6-4484-901e-c1bf9a48547e'} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-quobyte-200b8034-32b6-4484-901e-c1bf9a48547e-76ab42dc-9cb5-46d1-a9b4-7435e2155818" by "_create_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-200b8034-32b6-4484-901e-c1bf9a48547e-76ab42dc-9cb5-46d1-a9b4-7435e2155818" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Creating volume 76ab42dc-9cb5-46d1-a9b4-7435e2155818 from snapshot 200b8034-32b6-4484-901e-c1bf9a48547e {{(pid=87597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Selected osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f as target Quobyte volume. {{(pid=87597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-quobyte-76ab42dc-9cb5-46d1-a9b4-7435e2155818" by "_copy_volume_from_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-76ab42dc-9cb5-46d1-a9b4-7435e2155818" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] snapshot: 200b8034-32b6-4484-901e-c1bf9a48547e, volume: 76ab42dc-9cb5-46d1-a9b4-7435e2155818, {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[310aada5-4fd0-4443-90e6-e7b2ffca5273]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:08 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e Sep 09 04:00:08 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:08 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e" returned: 0 in 0.343s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf17b2ee-7c02-4a16-b370-074901460af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c7d04-84e1-48c5-ab5c-1b86abfd1046]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 04:00:08 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:08 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 Sep 09 04:00:08 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:09 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9" returned: 0 in 0.340s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] will copy from snapshot at /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 04:00:09 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Creating direct copy from snapshot {{(pid=87597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 04:00:09 devstack cinder-volume[87597]: DEBUG cinder.utils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Path /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 not found in is_blk_device check {{(pid=87597) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 04:00:09 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:09 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 Sep 09 04:00:09 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:13 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818" returned: 0 in 3.771s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.image.image_utils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Image conversion details: src /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9, size 1024.00 MB, duration 3.77 sec, destination /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 {{(pid=87597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 04:00:13 devstack cinder-volume[87597]: INFO cinder.image.image_utils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Converted 1024.00 MB image at 271.45 MB/s Sep 09 04:00:13 devstack cinder-volume[87597]: WARNING cinder.volume.drivers.remotefs [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 is being set with open permissions: ugo+rw Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:13 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 Sep 09 04:00:13 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:13 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818" returned: 0 in 0.227s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-76ab42dc-9cb5-46d1-a9b4-7435e2155818" released by "_copy_volume_from_snapshot" :: held 4.748s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-200b8034-32b6-4484-901e-c1bf9a48547e-76ab42dc-9cb5-46d1-a9b4-7435e2155818" released by "_create_volume_from_snapshot" :: held 4.803s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.820s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0779b1-2efe-45f2-83ae-6dc6a3affbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818', 'volume_size': 1, 'snapshot_id': '200b8034-32b6-4484-901e-c1bf9a48547e'}' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd15b87-3b03-4b8d-aa9b-be219a912ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 04:00:13 devstack cinder-volume[87597]: INFO cinder.volume.flows.manager.create_volume [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Volume volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 (76ab42dc-9cb5-46d1-a9b4-7435e2155818): created successfully Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd15b87-3b03-4b8d-aa9b-be219a912ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87597) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Flow 'volume_create_manager' (932bb0a2-51e7-43be-b5bf-086b6e18c336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87597) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 04:00:13 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-347ddf81-1807-4a8f-8106-5d1fa6ef6507 tempest-SnapshotDependencyTests-1268419799 None] Created volume successfully. Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-200b8034-32b6-4484-901e-c1bf9a48547e-delete_snapshot" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-200b8034-32b6-4484-901e-c1bf9a48547e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-quobyte-cf17b2ee-7c02-4a16-b370-074901460af9" by "delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-cf17b2ee-7c02-4a16-b370-074901460af9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-quobyte-200b8034-32b6-4484-901e-c1bf9a48547e" by "_delete_snapshot" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-200b8034-32b6-4484-901e-c1bf9a48547e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Deleting offline snapshot 200b8034-32b6-4484-901e-c1bf9a48547e of volume cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] snapshot_file for this snap is: volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e {{(pid=87597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[802117ed-9724-4817-955c-8c293387c406]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 04:00:13 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:13 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e Sep 09 04:00:13 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:14 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e" returned: 0 in 0.357s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:14 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.remotefs [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf17b2ee-7c02-4a16-b370-074901460af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 04:00:14 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[408ce40f-0005-417d-9025-6120e45a6d7f]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 04:00:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:14 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 Sep 09 04:00:14 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:14 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9" returned: 0 in 0.492s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:14 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:14 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e Sep 09 04:00:14 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:15 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e" returned: 0 in 0.320s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:15 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e Sep 09 04:00:15 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:15 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9.200b8034-32b6-4484-901e-c1bf9a48547e" returned: 0 in 0.232s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-200b8034-32b6-4484-901e-c1bf9a48547e" released by "_delete_snapshot" :: held 1.490s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-cf17b2ee-7c02-4a16-b370-074901460af9" released by "delete_snapshot" :: held 1.509s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Created reservations ['22f4c8cf-6c9d-4118-a0d2-86118cd0d0e7', 'ae347a91-22f3-4716-86af-4f166ea8d52d', '0b7e3ca7-5eb6-4e54-85d6-71571b14c084', '8b95a4b4-ae24-4a87-996c-eaed734ba950'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 04:00:15 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Delete snapshot completed successfully. Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-6c0557b0-5287-409f-9665-cb5c2b82e7dd tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-200b8034-32b6-4484-901e-c1bf9a48547e-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-cf17b2ee-7c02-4a16-b370-074901460af9-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:15 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-cf17b2ee-7c02-4a16-b370-074901460af9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-quobyte-cf17b2ee-7c02-4a16-b370-074901460af9" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-cf17b2ee-7c02-4a16-b370-074901460af9" acquired by "delete_volume" :: waited 0.016s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e9b295-27af-4bf3-850e-3c66524bec1b]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:16 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 Sep 09 04:00:16 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:16 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9" returned: 0 in 0.333s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:16 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9 Sep 09 04:00:16 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:16 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-cf17b2ee-7c02-4a16-b370-074901460af9" returned: 0 in 0.230s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-cf17b2ee-7c02-4a16-b370-074901460af9" released by "delete_volume" :: held 0.612s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Created reservations ['384eac76-1350-4e2d-b52c-4f747ac2c864', 'a007e404-78a5-4815-97e5-596d6f863335', '8337a440-0be0-48d6-81a7-ca6d61956909', 'c4efa3bb-deae-4ba5-827d-b89675fe6a75'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:16 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 04:00:16 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:16 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.225s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:16 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 04:00:16 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Deleted volume successfully. Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-355d3538-ed6e-4f76-aaa6-a5d288da35b8 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-cf17b2ee-7c02-4a16-b370-074901460af9-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-76ab42dc-9cb5-46d1-a9b4-7435e2155818-delete_volume" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-76ab42dc-9cb5-46d1-a9b4-7435e2155818-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "cinder-quobyte-76ab42dc-9cb5-46d1-a9b4-7435e2155818" by "delete_volume" {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-76ab42dc-9cb5-46d1-a9b4-7435e2155818" acquired by "delete_volume" :: waited 0.015s {{(pid=87597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo.privsep.daemon [-] privsep: reply[782f308d-e27e-47b6-b93f-cde691045887]: (4, 'qcow2') {{(pid=88854) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:17 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 Sep 09 04:00:17 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:17 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818" returned: 0 in 0.345s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:17 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818 Sep 09 04:00:17 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:17 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b/volume-76ab42dc-9cb5-46d1-a9b4-7435e2155818" returned: 0 in 0.232s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-quobyte-76ab42dc-9cb5-46d1-a9b4-7435e2155818" released by "delete_volume" :: held 0.612s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.quota [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Created reservations ['116b3f49-d798-4e90-9d8c-cf689db9f96e', 'e3ed57a2-f6d1-4f01-9c2d-c5767de5120c', '253709a4-d2f8-498c-b432-6a87df57fed2', 'c25bac70-6257-40ff-8d97-af9a966d7585'] {{(pid=87597) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:17 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:17 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 04:00:17 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:18 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:18 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.240s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:18 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 04:00:18 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Deleted volume successfully. Sep 09 04:00:18 devstack cinder-volume[87597]: DEBUG cinder.coordination [None req-10198723-204c-4f42-9d4e-31d98927dbb5 tempest-SnapshotDependencyTests-1268419799 None] Lock "cinder-76ab42dc-9cb5-46d1-a9b4-7435e2155818-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87597) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 04:00:27 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=30,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 04:00:28 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:UPDATE=29,cinder:INSERT=7,cinder:SELECT=19,cinder:DELETE=3 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f': None} {{(pid=87597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG cinder.volume.drivers.quobyte [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-503a12d9-79a7-4d16-a601-5ec765b3793f'] {{(pid=87597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87597) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 04:00:37 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b Sep 09 04:00:37 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 04:00:37 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG oslo_concurrency.processutils [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/21be461da26a28320ecec321933d8d0b" returned: 0 in 0.280s {{(pid=87597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG cinder.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Notifying Schedulers of capabilities ... {{(pid=87597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG oslo_service.periodic_task [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87597) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread count: 28 {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 04:00:37 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-4721ada8-9307-40d1-8865-bbfb9fb1c0a1 None None] thread info: [<_MainThread(MainThread, started 133600894054528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87597) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 04:00:45 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}